-- Logs begin at Fri 2022-09-09 12:36:31 UTC, end at Fri 2022-09-09 13:36:37 UTC. -- Sep 09 13:06:10.960425 dv-cinder-831247-26-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 13:06:10.969840 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 13:06:10.971771 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 13:06:10 2022] *** Sep 09 13:06:10.971771 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 13:06:10.971771 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 13:06:10.971771 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: nodename: dv-cinder-831247-26-iscsi Sep 09 13:06:10.971771 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: machine: x86_64 Sep 09 13:06:10.971771 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: clock source: unix Sep 09 13:06:10.971771 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: pcre jit disabled Sep 09 13:06:10.971771 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: detected number of CPU cores: 4 Sep 09 13:06:10.971771 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: current working directory: / Sep 09 13:06:10.971771 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: detected binary path: /usr/bin/uwsgi-core Sep 09 13:06:10.972463 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: your processes number limit is 47680 Sep 09 13:06:10.972463 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: your memory page size is 4096 bytes Sep 09 13:06:10.972463 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: detected max file descriptor number: 2048 Sep 09 13:06:10.972463 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: lock engine: pthread robust mutexes Sep 09 13:06:10.972463 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: thunder lock: enabled Sep 09 13:06:10.972463 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 13:06:10.972463 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 13:06:11.011439 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: Python main interpreter initialized at 0x55a1e1fda9c0 Sep 09 13:06:11.011439 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: python threads support enabled Sep 09 13:06:11.011439 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: your server socket listen backlog is limited to 100 connections Sep 09 13:06:11.011439 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: your mercy for graceful operations on workers is 90 seconds Sep 09 13:06:11.011765 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 13:06:11.011847 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: *** Operational MODE: preforking *** Sep 09 13:06:11.012106 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: *** uWSGI is running in multiple interpreter mode *** Sep 09 13:06:11.012106 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: spawned uWSGI master process (pid: 105610) Sep 09 13:06:11.012283 dv-cinder-831247-26-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 13:06:11.013361 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: spawned uWSGI worker 1 (pid: 105611, cores: 1) Sep 09 13:06:11.013361 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: spawned uWSGI worker 2 (pid: 105612, cores: 1) Sep 09 13:06:11.013361 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 13:06:11.676233 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 13:06:11.676827 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 13:06:12.767822 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 13:06:12.767822 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: from cryptography.utils import int_from_bytes Sep 09 13:06:12.768403 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 13:06:12.768403 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: from cryptography.utils import int_from_bytes Sep 09 13:06:12.768697 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 13:06:12.768697 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: from cryptography.utils import int_from_bytes Sep 09 13:06:12.769143 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 13:06:12.769143 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: from cryptography.utils import int_from_bytes Sep 09 13:06:15.301619 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 13:06:15.302184 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 13:06:15.302287 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 13:06:15.302652 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 13:06:15.302733 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 13:06:15.302823 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 13:06:15.302929 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 13:06:15.303087 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 13:06:15.303312 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 13:06:15.303414 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.303565 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 13:06:15.303665 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.304612 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.304776 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.304927 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.305058 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.305251 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.305341 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.305562 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.305657 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.305884 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.305981 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.306202 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.306304 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.306530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.306615 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.306790 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.306886 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.307129 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.307230 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.307440 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.307533 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-26-iscsi {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.307757 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.307850 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.308063 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.308148 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-26-iscsi {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.308371 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.308463 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.308684 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.308776 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.308984 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.309067 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.309299 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.309393 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.309603 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.309695 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.309921 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.310097 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.310228 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.311430 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.311605 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.311749 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.311874 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.311997 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.312129 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.312261 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.312374 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.312521 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.312651 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.312792 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.312920 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.313042 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.313169 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.313298 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.313421 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.313548 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.313679 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.313819 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.313940 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.314062 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-26-iscsi {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.314192 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.314324 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.314445 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-26-iscsi {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.314574 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.314709 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.314841 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.314965 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.315134 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.315261 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.315397 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.315530 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.315654 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.315765 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.315896 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.316032 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.316208 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.316335 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.316517 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.316651 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.316845 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.316974 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.317165 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.317292 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.317482 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.317610 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.317801 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.317937 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.318105 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.318233 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.318412 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.318540 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.318719 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.318847 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.319037 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.319209 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.319413 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.320125 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.320331 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.320539 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.320694 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.320820 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.320943 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.321083 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.321209 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.321337 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.321460 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.321583 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.321768 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.321982 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.322112 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.322236 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.322370 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.322496 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.322632 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.322755 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.322884 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.323010 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.323188 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.323337 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.323495 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.323620 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.323799 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.323926 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.324104 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.324239 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.324411 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.324586 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.324721 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.324903 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.325029 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.325211 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.325341 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.325519 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.325647 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.325826 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.325963 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.326145 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.326283 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.326459 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.326593 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.326782 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.326919 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.327114 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.327245 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.327439 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.327567 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.327743 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.327879 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.328073 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.328199 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.328381 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.328509 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.328684 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.328819 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.329004 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.329139 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.329321 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.329452 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.329626 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.329762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.329931 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.330099 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.330245 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.330372 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.330531 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.330668 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.330836 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.330971 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.331178 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.331306 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.331442 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.331566 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.331717 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.331854 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.332021 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.332159 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.332328 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.332454 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.332631 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.332758 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.332936 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.333062 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.333238 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.333364 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.333535 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.333660 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.333838 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.333977 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.334138 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.334273 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.334439 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.334566 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.334740 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.334875 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.335118 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.335314 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.335517 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.335721 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.335721 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.336009 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.336136 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.336258 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.336380 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.336512 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.336636 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.336768 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.336897 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.337027 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.337151 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.337282 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.337446 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.337584 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.337747 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.337885 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.338051 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.338186 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.338353 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.338488 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.338656 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.338784 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.338958 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.339108 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.339286 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.339427 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.339591 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.339717 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.339895 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.340030 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.340199 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.340336 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.340504 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.340631 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.340809 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.340945 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.341109 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.341244 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.341416 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.341549 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.341714 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.341840 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.342020 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.342149 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.342319 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.342444 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.342626 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.342753 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.342928 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.343110 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.343258 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.343399 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.343563 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.343698 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.343867 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.343996 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.344171 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.344298 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.344474 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.344611 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.344777 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.344919 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.345077 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.345212 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.345381 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.345521 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.345687 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.345822 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.345995 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.346121 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.346301 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.346436 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.346604 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.346733 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.346940 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.347101 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.347229 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.347367 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.347537 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:06:15.347669 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.347872 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.348000 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.348204 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.348413 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.348540 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.348671 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.348849 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.348977 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.349165 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.349292 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.349479 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.349614 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.349792 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.349928 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.350101 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.350228 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.350415 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.350552 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.351299 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.351506 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.351732 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.351865 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.351989 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.352113 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.352243 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.352393 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.352530 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.352657 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.352809 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.352937 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.353139 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.353268 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.353455 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.353582 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.353767 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.353902 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.354082 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.354220 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.354393 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.354520 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.354712 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.354848 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.355022 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.355187 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.355372 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.355499 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.355687 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.355815 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.356028 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.356163 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.356356 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.356485 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.356673 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.356809 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.356983 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.357116 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.357295 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.357424 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.357607 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.357734 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.357916 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.358044 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.358228 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.358364 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.358554 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.358686 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.358873 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.359004 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.359208 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.359335 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.359529 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.359654 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.359840 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.359969 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.360151 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.360287 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.360462 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.360598 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.360771 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.360898 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.361077 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.361215 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.361386 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.361512 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.361698 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.361827 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.362030 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.362157 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.362346 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.362480 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.362654 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.362780 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.362969 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.363114 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.363305 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.363446 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.363616 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.363741 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.363925 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.364058 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.364229 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.364365 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.364535 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.364664 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.364837 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.364963 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.365144 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.365283 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.365445 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.365571 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.365755 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.365875 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.366062 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.366198 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.366982 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.367274 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.367475 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.367629 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.367765 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.367890 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.368022 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.368148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.368270 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.368401 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.368559 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.368688 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.368869 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.368998 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.369180 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.369308 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.369488 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.369617 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.369800 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.369935 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.370112 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.370249 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.370419 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.370551 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.370742 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.370869 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.371080 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.371225 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.371384 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.371512 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.371707 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.371834 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.372013 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.372219 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.372346 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.372479 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.372626 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.372753 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.372937 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.373074 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.373248 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.373374 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.373561 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.373690 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.373874 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.374008 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.374186 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.374321 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.374490 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.374617 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.374792 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.374922 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.375149 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.375279 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.375477 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.375614 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.375781 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.375909 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.376102 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.376229 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.376408 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.376535 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.376718 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.376847 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.377022 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.377149 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.377327 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.377469 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.377628 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.377763 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.377934 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.378069 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.378235 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.378411 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.378539 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.378661 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.378829 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.378957 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.379156 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.379299 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.379460 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.379586 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.379762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.379890 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.380065 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.380201 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.380366 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.380492 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.380672 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.380808 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.380973 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.381101 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.381277 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.381405 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.381579 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.381706 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.381947 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.382140 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.382348 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.382559 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.382692 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.382817 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.382950 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.383109 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.383247 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.383371 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.383536 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.383665 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.383849 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.383978 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.384158 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.384285 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.384465 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.384601 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.384774 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.384900 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.385082 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.385208 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.385390 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.385530 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.385707 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.385833 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.386012 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.386140 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.386327 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.386465 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.386634 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.386760 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.386955 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.387121 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.387287 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.387423 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.387600 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.387726 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.387904 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.388030 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.388219 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.388357 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.388556 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.388682 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.388882 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.389009 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.389194 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.389322 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.389505 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.389631 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.389811 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.389937 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.390117 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.390243 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.390424 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.390551 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.390731 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.390857 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.391038 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.391194 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.391371 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.391512 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.391689 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.391814 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.391994 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.392121 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.392313 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.392453 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.392619 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.392753 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.392934 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.393060 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.393239 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.393366 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.393552 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.393690 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.393854 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.393980 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.394166 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.394293 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.394492 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.394627 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.394804 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.394932 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.395127 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.395253 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.395442 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.395582 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.395749 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.395875 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.396060 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.396182 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.396368 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.396503 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.396672 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.396798 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.396979 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.397107 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.397282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.397402 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.397634 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.397836 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.398053 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.398257 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.398398 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.398531 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.398657 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.398781 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.398912 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.399067 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.399210 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.399336 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.399473 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.399606 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.399731 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.399855 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.400028 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.400157 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.400339 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.400475 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.400659 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.400867 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.400995 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.401127 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.401273 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.401401 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.401576 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.401714 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.401898 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.402026 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.402206 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.402334 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.402508 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.402649 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.402811 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.402948 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.403131 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.403258 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.403427 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.403569 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.403732 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.403859 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.404049 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.404175 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.404362 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.404491 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.404664 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.404790 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.404972 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.405099 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.405286 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.405422 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.405592 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.405726 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.405896 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.406022 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.406203 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.406337 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.406512 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.406639 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.406815 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.406940 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.407148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.407279 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.407456 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.407581 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.407761 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.407899 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.408067 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.408195 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.408376 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.408504 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.408680 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.408813 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.408987 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.409115 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.409290 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.409423 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.409590 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.409729 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.409896 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.410022 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.410201 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.410329 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.410510 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.410764 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.410893 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.411122 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.411410 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.411541 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.411742 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.411871 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.412058 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.412199 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.412378 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.412517 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.412705 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.412845 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.413025 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.413743 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.413919 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.414108 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.414326 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.414524 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.414724 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.414872 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.414999 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.415140 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.415281 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.415407 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.415542 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.415667 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.415797 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.415922 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.416055 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.416180 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.416316 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.416440 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.416573 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.416698 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.416828 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.416952 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.417085 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.417262 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.417391 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.417569 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.417691 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.417873 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.418011 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.418177 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.418306 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.418481 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.418610 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.418797 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.418926 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.419125 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.419255 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.419439 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.419567 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.419746 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.419876 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.420062 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.420189 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.420368 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.420504 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.420670 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.420798 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.421230 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.421359 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.421533 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.421667 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.421872 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.422001 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.422177 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.422306 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.422516 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.422653 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.422820 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.422948 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.423171 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.423312 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.423480 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.423616 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.423781 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.423908 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.424081 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.424215 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.424391 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.424528 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.424695 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.424838 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.424996 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.425122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.425322 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.425455 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.425587 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.425711 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.425882 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.426011 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.426188 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.426316 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.426492 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.426626 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.426798 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.426925 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.427108 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.427234 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.427424 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.427554 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.427729 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.427856 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.428030 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.428166 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.428334 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.428468 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.428638 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.428835 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.429542 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.429740 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.429943 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.430141 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.430141 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.430409 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.430534 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.430659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.430781 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.430905 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.431028 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.431188 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.431324 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.431450 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.431609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.431746 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.431924 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.432063 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.432231 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.432360 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.432534 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.432662 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.432857 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.432998 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.433167 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.433295 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.433468 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.433600 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.433769 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.433897 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.434076 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.434204 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.434378 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.434504 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.434677 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.434805 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.434981 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.435144 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.435310 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.435448 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.435613 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.435743 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.435923 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.436050 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.436232 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.436359 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.436535 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.436663 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.436837 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.436975 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.437137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.437273 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.437440 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.437568 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.437741 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.437866 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.438041 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.438177 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.438336 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.438463 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.438636 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.438771 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.438936 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.439091 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.439260 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.439390 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.439564 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.439692 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.439867 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.440008 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.440170 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.440297 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.440475 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.440602 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.440774 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.440902 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.441081 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.441209 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.441384 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.441519 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.441726 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.441856 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.442032 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.442160 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.442357 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.442483 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.442668 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.442805 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.442979 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.443137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.443318 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.443444 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.443625 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.443754 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.443934 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.444066 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.444244 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.444400 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.444704 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.444918 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.445147 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.445285 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.445419 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.445553 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.445678 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.445802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.445928 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.446051 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.446208 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.446345 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.446528 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.446656 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.446851 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.446979 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.447190 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.447336 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.447492 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.447619 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.447800 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.447921 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.448111 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.448247 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.448419 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.448545 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.448726 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.448853 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.449033 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.449161 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.449340 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.449468 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.449648 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.449774 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.449954 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.450083 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.450262 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.450390 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.450569 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.450694 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.450872 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.451000 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.451203 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.451343 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.451512 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.451639 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.451814 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.451941 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.452126 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.452253 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.452433 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.452575 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.452737 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.452863 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.453046 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.453173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.453349 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.453485 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.453650 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.453777 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.453952 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.454078 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.454255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.454461 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.454596 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.454720 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.454843 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.454974 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.455287 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.455416 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.455597 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.455723 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.455905 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.456039 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.456208 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.456336 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.456519 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.456653 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.456824 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.456959 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.457142 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.457269 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.457458 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.457586 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.457765 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.457892 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.458128 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.458255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.458433 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.458569 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.458737 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.458864 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.459079 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.459223 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.459382 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.459520 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.459684 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.459819 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.460018 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.460204 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.460399 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.460597 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.460902 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.461054 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.461054 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.461291 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.461291 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.461548 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.461696 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.461829 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.461955 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.462138 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.462266 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.462464 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.462599 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.462884 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.463021 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.463219 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.463348 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.463525 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.463666 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.463846 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.463993 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.464169 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.464291 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.464475 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.464610 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.464788 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.464996 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.465124 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.465247 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.465406 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.465536 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.465731 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.465869 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.466043 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.466178 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.466354 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.466480 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.466657 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.466792 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.466979 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.467135 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.467324 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.467452 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.467635 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.467774 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.467937 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.468065 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.468259 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.468387 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.468584 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.468713 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.468898 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.469027 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.469218 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.469353 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.469579 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.469707 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.469886 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.470016 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.470192 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.470321 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.470502 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.470635 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.470807 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.470935 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.471135 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.471277 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.471458 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.471589 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.471766 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.471892 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.472071 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.472210 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.472376 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.472506 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.472682 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.472807 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.472987 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.473127 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.473292 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.473421 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.473598 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.473733 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.473902 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.474041 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.474204 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.474339 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.474529 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.474662 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.474829 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.474967 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.475141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.475268 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.475465 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.476095 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.476285 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.476491 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.476702 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.476842 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.476968 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.477091 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.477230 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.477358 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.477508 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.477661 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.477817 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.478007 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.478149 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.478313 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.478482 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.478632 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.478769 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.478964 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.479125 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.479334 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.479464 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.479646 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.479775 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.479974 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.480102 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.480298 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.480426 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.480605 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.480733 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.480912 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.481041 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.481231 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.481358 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.481549 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.481680 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.481857 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.481985 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.482164 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.482310 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.482473 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.482612 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.482777 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.482903 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.483101 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.483244 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.483410 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.483548 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.483711 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.483847 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.484012 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.484139 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.484314 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.484450 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.484615 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.484742 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.484916 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.485043 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.485219 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.485360 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.485521 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.485650 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.485836 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.485970 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.486136 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.486264 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.486440 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.486567 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.486745 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.486873 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.487066 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.487207 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.487379 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.487516 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.487684 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.487813 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.488014 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.488150 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.488317 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.488444 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.488642 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.488775 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.488948 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.489078 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.489262 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.489388 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.489576 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.489713 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.489890 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.490017 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.490204 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.490329 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.490515 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.490651 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.490825 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.490953 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.491164 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.491840 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.492078 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.492298 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.492509 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.492660 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.492799 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.492925 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.493077 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.493222 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.493406 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.493722 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.493849 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.494037 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.494179 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.494350 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.494479 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.494661 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.494788 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.494973 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.495216 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.495355 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.495490 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.495616 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.495740 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.495907 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.496044 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.496216 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.496343 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.496526 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.496661 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.496838 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.496968 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.497161 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.497297 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.497481 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.497609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.497802 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.497937 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.498127 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.498256 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.498442 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.498568 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.498756 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.498891 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.499086 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.499217 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.499408 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.499550 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.499740 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.499868 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.500058 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.500199 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.500364 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.500507 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.500678 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.500813 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.500991 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.501118 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.501299 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.501426 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.501607 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.501733 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.501918 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.502054 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.502232 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.502360 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.502542 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.502671 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.502850 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.502986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.503184 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.503315 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.503501 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.503631 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.503817 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.503960 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.504142 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.504269 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.504460 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.504588 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.504778 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.504919 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.505091 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.505225 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.505406 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.505609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.505744 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.505926 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.506228 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.506363 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.506549 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.506678 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.506908 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.507158 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.507359 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.507602 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.507823 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.507958 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.508094 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.508221 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.508345 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.508469 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.508593 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.508773 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.508912 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.509083 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.509211 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.509388 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.509516 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.509700 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.509837 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.510007 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.510134 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.510312 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.510446 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.510630 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.510758 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.510939 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.511089 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.511270 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.511494 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.511634 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.511842 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.511972 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.512165 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.512407 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.512536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.512754 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.512891 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.513071 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.513198 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.513398 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.513525 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.513723 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.513849 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.514029 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.514165 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.514336 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.514470 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.514651 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.514776 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.514955 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.515146 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.515273 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.515404 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.515577 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.515707 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.515889 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.516016 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.516194 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.516323 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.516497 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.516631 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.516805 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.516938 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.517105 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.517242 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.517412 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.517537 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.517722 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.517849 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.518026 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.518161 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.518329 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.518455 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.518640 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.518769 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.518941 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.519090 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.519270 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.519400 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.519575 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.519700 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.519877 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.520003 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.520183 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.520311 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.520485 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.520618 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.520789 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.520923 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.521093 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.521227 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.521394 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.521534 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.521705 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.521840 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.522010 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.522138 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.522322 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.522501 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.522677 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.522875 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.523141 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.523277 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.523401 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.523540 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.523666 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.523791 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.523922 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.524046 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.524210 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.524415 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.524544 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.524666 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.524817 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.524953 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.525137 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.525264 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.525451 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.525579 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.525762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.525983 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.526124 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.526319 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.526454 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.526642 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.526930 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.527087 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.527295 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.527425 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.527618 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.527745 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.527926 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.528062 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.528235 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.528363 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.528559 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.528691 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.528868 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.529007 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.529174 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.529301 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.529481 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.529606 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.529792 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.529929 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.530103 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.530228 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.530409 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.530534 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.530717 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.530852 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.531025 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.531199 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.531357 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.531483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.531664 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.531792 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.531972 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.532098 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.532279 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.532411 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.532585 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.532713 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.532891 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.533018 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.533197 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.533324 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.533506 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.533636 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.533814 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.533943 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.534128 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.534265 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.534444 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.534571 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.534768 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.534895 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.535100 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.535242 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.535414 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.535541 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.535724 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.535852 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.536032 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.536168 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.536342 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.536471 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.536652 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.536781 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.536963 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.537101 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.537264 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.537391 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.537591 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.537904 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.538040 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.538747 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.538938 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.539280 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.539609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.539738 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.539929 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.540059 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.540256 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.540385 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.540582 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.540710 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.540894 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.541030 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.541216 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.541344 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.541523 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.541659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.541841 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.541968 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.542163 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.542302 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.542476 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.542614 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.542807 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.542936 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.543133 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.543261 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.543443 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.543587 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.543748 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.543877 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.544059 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.544195 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.544379 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.544511 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.544683 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.544810 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.544988 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.545116 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.545293 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.545422 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.545602 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.545730 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.546158 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.546295 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.546465 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.546603 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.546768 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.546897 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.547137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.547278 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.547406 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.547531 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.547688 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.547818 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.547992 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.548129 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.548296 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.548439 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.548600 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.548730 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.548903 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.549039 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.549204 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.549331 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.549504 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.549631 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.549803 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.549943 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.550102 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.550230 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.550403 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.550538 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.550705 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.550845 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.551004 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.551148 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.551343 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.551470 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.551692 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.551830 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.551956 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.552080 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.552269 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.552406 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.552586 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.552714 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.552903 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.553029 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.553209 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.553342 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.553524 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.553652 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.554428 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.554604 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.554784 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.555088 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.555267 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.555449 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.555595 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.555733 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.555859 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.555993 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.556120 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.556251 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.556383 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.556517 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.556641 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.556774 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.556900 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.557061 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.557190 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.557371 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.557499 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.557703 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.557841 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.558033 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.558164 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.558343 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.558480 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.558671 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.558808 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.558990 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.559139 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.559341 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.559482 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.559659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.559786 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.559969 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.560104 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.560283 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.560423 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.560594 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.560723 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.560902 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.561029 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.561213 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.561343 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.561521 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.561647 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.561828 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.561954 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.562138 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.562265 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.562449 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.562580 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.562759 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.562892 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.563092 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.563225 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.563406 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.563534 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.563722 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.563864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.564038 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.564167 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.564347 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.564475 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.564675 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.564816 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.564982 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.565136 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.565311 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.565440 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.565631 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.565766 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.565973 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.566099 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.566284 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.566411 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.566602 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.566741 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.566914 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.567087 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.567260 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.567389 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.567533 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 13:06:15.567661 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.567916 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:06:15.568159 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 13:06:15.721916 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO dbcounter [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] Registered counter for database nova_api Sep 09 13:06:15.722163 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO dbcounter [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Registered counter for database nova_api Sep 09 13:06:15.742854 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_db.sqlalchemy.engines [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:06:15.746145 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_db.sqlalchemy.engines [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:06:15.749709 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writer thread running {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:06:15.752761 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writer thread running {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:06:15.809326 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.context [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),097b70e7-360a-44be-bba2-9f31f45eed49(cell1) {{(pid=105612) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 13:06:15.811603 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.context [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),097b70e7-360a-44be-bba2-9f31f45eed49(cell1) {{(pid=105611) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 13:06:15.813431 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:15.813910 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:15.815495 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:15.815747 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:15.816211 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:15.816322 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:15.816654 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:15.817795 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:15.818509 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:06:15.818637 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_concurrency.lockutils [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:15.818951 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:06:15.821219 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO dbcounter [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] Registered counter for database nova_cell0 Sep 09 13:06:15.821533 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:06:15.823554 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO dbcounter [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Registered counter for database nova_cell0 Sep 09 13:06:15.825201 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO dbcounter [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] Registered counter for database nova_cell1 Sep 09 13:06:15.827548 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO dbcounter [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Registered counter for database nova_cell1 Sep 09 13:06:15.832589 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_db.sqlalchemy.engines [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:06:15.834173 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_db.sqlalchemy.engines [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:06:15.836569 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_db.sqlalchemy.engines [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:06:15.839732 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_db.sqlalchemy.engines [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:06:15.841185 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writer thread running {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:06:15.842687 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writer thread running {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:06:15.842990 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writer thread running {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:06:15.986174 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writer thread running {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:06:15.991800 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO dbcounter [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] Registered counter for database nova_cell0 Sep 09 13:06:15.996078 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO dbcounter [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Registered counter for database nova_cell0 Sep 09 13:06:16.000442 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG oslo_db.sqlalchemy.engines [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:06:16.004580 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_db.sqlalchemy.engines [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:06:16.005222 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writer thread running {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:06:16.010270 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writer thread running {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:06:16.345594 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: WARNING keystonemiddleware.auth_token [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 13:06:16.347877 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: WARNING keystonemiddleware.auth_token [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 13:06:16.353751 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: WARNING keystonemiddleware.auth_token [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 13:06:16.355773 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: WARNING keystonemiddleware.auth_token [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 13:06:16.698642 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: WARNING keystonemiddleware.auth_token [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 13:06:16.703886 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: WARNING keystonemiddleware.auth_token [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 13:06:16.704620 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: WARNING keystonemiddleware.auth_token [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 13:06:16.709903 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: WARNING keystonemiddleware.auth_token [None req-f56b93fe-fc0f-4a78-9d60-2ea99aef2c07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 13:06:16.710013 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a1e1fda9c0 pid: 105611 (default app) Sep 09 13:06:16.712062 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:06:16.713256 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Sep 09 13:06:16.713668 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Fri Sep 9 13:06:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:06:16.715247 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a1e1fda9c0 pid: 105612 (default app) Sep 09 13:07:38.343641 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:38.345340 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Sep 09 13:07:38.345743 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 13:07:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:07:38.357619 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_api:SELECT=3 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:38.358760 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_cell1:SELECT=3 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:38.359583 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_cell0:SELECT=3 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:38.360593 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:39.279753 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-0f2cae9e-8853-4b9e-a3fc-142cf20ce42a admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:39.313994 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-0f2cae9e-8853-4b9e-a3fc-142cf20ce42a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.961365 Sep 09 13:07:39.314656 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1292 bytes} [Fri Sep 9 13:07:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:41.942100 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:41.943128 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-a54a1a56-a2c9-460c-9e02-4f7298265e17 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Sep 09 13:07:41.943735 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 13:07:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:07:42.389687 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-41a11d42-4e6a-4eb1-9c18-59f7c79b7296 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "name": "cirros256", "id": "c1", "swap": 0}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:42.438588 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-41a11d42-4e6a-4eb1-9c18-59f7c79b7296 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.488970 Sep 09 13:07:42.439179 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 13:07:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:07:42.452845 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:SELECT=3 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:42.454786 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell0:SELECT=3 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:42.455546 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell1:SELECT=3 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:42.456600 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:07:42.662517 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-2859c8c5-023b-40dd-9660-0cfa6ddc79fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:42.733294 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-2859c8c5-023b-40dd-9660-0cfa6ddc79fd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285847 Sep 09 13:07:42.733883 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 9 13:07:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:45.355874 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-41a11d42-4e6a-4eb1-9c18-59f7c79b7296 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:45.356886 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-41a11d42-4e6a-4eb1-9c18-59f7c79b7296 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 09 13:07:45.357515 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 13:07:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:07:46.021877 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-d0c15c71-fd9b-45a1-a5c4-be34bcb01d84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:46.063555 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-d0c15c71-fd9b-45a1-a5c4-be34bcb01d84 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.699775 Sep 09 13:07:46.064413 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 13:07:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:07:46.076284 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-f26e36db-7657-46ed-b42a-0d60e4ca90ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:46.115551 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-f26e36db-7657-46ed-b42a-0d60e4ca90ac admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042893 Sep 09 13:07:46.116130 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 9 13:07:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:07:48.725544 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-d0c15c71-fd9b-45a1-a5c4-be34bcb01d84 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:48.726562 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-d0c15c71-fd9b-45a1-a5c4-be34bcb01d84 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 09 13:07:48.726975 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 13:07:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:07:49.152065 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-189c233e-9846-455f-91d1-29b686426c81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:49.173730 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-189c233e-9846-455f-91d1-29b686426c81 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439973 Sep 09 13:07:49.174453 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 13:07:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:07:49.187419 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-218b738b-20b8-42f2-9284-901ac5a1b3cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:49.214861 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-218b738b-20b8-42f2-9284-901ac5a1b3cd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031765 Sep 09 13:07:49.215818 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 9 13:07:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:51.830763 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-189c233e-9846-455f-91d1-29b686426c81 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:51.832410 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-189c233e-9846-455f-91d1-29b686426c81 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002073 Sep 09 13:07:51.832967 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 13:07:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:07:52.256235 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-cc359321-596d-4d72-8694-708e1cdf65e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "swap": 0, "ram": 2048, "id": "d3"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:52.275309 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-cc359321-596d-4d72-8694-708e1cdf65e8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435989 Sep 09 13:07:52.276069 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 13:07:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:07:52.288165 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-fa78d99a-7cce-4592-a769-c2d6e1381120 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:52.316574 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-fa78d99a-7cce-4592-a769-c2d6e1381120 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031983 Sep 09 13:07:52.317457 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 9 13:07:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:54.961470 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-cc359321-596d-4d72-8694-708e1cdf65e8 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:54.962525 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-cc359321-596d-4d72-8694-708e1cdf65e8 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 09 13:07:54.962945 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 13:07:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:07:55.387499 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-71d7c3cb-aa6a-4dc4-a148-ece059c1b288 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "ram": 4096, "name": "ds4G", "disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:55.407006 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-71d7c3cb-aa6a-4dc4-a148-ece059c1b288 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436944 Sep 09 13:07:55.407803 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 13:07:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:07:55.420184 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-f63bd33b-5133-4ae1-adab-205155204261 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:07:55.447684 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-f63bd33b-5133-4ae1-adab-205155204261 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031455 Sep 09 13:07:55.448290 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1336 bytes} [Fri Sep 9 13:07:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:07:58.064273 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-71d7c3cb-aa6a-4dc4-a148-ece059c1b288 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:58.065290 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-71d7c3cb-aa6a-4dc4-a148-ece059c1b288 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 09 13:07:58.065692 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 13:07:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:07:58.530095 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-e5ea8dde-5cbf-4a69-8e7b-0b2529eb1ec6 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:07:58.559875 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-e5ea8dde-5cbf-4a69-8e7b-0b2529eb1ec6 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.487855 Sep 09 13:07:58.560518 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1292 bytes} [Fri Sep 9 13:07:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:08:01.176889 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-71d7c3cb-aa6a-4dc4-a148-ece059c1b288 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:01.177910 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-71d7c3cb-aa6a-4dc4-a148-ece059c1b288 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 09 13:08:01.178313 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 13:08:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:01.583410 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-dc592781-4ec5-4f54-ac0d-86566278ad65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "id": "1", "rxtx_factor": 1.0}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:01.616599 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-dc592781-4ec5-4f54-ac0d-86566278ad65 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.432296 Sep 09 13:08:01.617267 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 13:08:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:08:01.630036 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-f0a1c124-332f-4871-9a94-4f586e26fd4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:01.657940 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-f0a1c124-332f-4871-9a94-4f586e26fd4f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031470 Sep 09 13:08:01.659100 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 9 13:08:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:08:04.244852 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-dc592781-4ec5-4f54-ac0d-86566278ad65 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:04.245768 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-dc592781-4ec5-4f54-ac0d-86566278ad65 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 09 13:08:04.246165 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 13:08:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:04.696647 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-e7820bd3-301c-4878-9f28-bf23f0270865 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "disk": 20, "swap": 0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:04.715973 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-e7820bd3-301c-4878-9f28-bf23f0270865 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.463610 Sep 09 13:08:04.716722 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 13:08:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:08:04.729129 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-ec6dbcc0-9c6d-4c9c-af06-495c3e83e17c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:04.754835 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-ec6dbcc0-9c6d-4c9c-af06-495c3e83e17c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029403 Sep 09 13:08:04.756058 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 9 13:08:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:08:07.413259 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-e7820bd3-301c-4878-9f28-bf23f0270865 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:07.414283 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-e7820bd3-301c-4878-9f28-bf23f0270865 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Sep 09 13:08:07.414692 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 13:08:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:07.886778 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-5fb82763-28a0-4f67-9694-39e4f1ce4e43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "name": "m1.medium", "disk": 40, "swap": 0, "ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:07.908162 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-5fb82763-28a0-4f67-9694-39e4f1ce4e43 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.487047 Sep 09 13:08:07.909526 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 13:08:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:08:07.922153 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-06c9943c-360c-4dfa-95cc-9bd80eb37744 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:07.951503 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-06c9943c-360c-4dfa-95cc-9bd80eb37744 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033087 Sep 09 13:08:07.967366 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 9 13:08:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:08:10.627221 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-5fb82763-28a0-4f67-9694-39e4f1ce4e43 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:10.628534 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-5fb82763-28a0-4f67-9694-39e4f1ce4e43 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Sep 09 13:08:10.629943 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 13:08:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:11.082659 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-b297e776-bcdd-4497-a7d6-d8b21d6efe34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "vcpus": 4, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:11.088766 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:08:11.104873 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-b297e776-bcdd-4497-a7d6-d8b21d6efe34 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.469590 Sep 09 13:08:11.105707 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 13:08:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:08:11.118641 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-58be5388-de17-47ef-82aa-366d2883986b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:11.143682 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-58be5388-de17-47ef-82aa-366d2883986b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028663 Sep 09 13:08:11.144526 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 9 13:08:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:08:13.781977 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-b297e776-bcdd-4497-a7d6-d8b21d6efe34 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:13.783001 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-b297e776-bcdd-4497-a7d6-d8b21d6efe34 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 09 13:08:13.783755 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 13:08:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:14.396584 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-d5c632a1-c2cd-40d9-ac85-b206bac84b5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:14.403187 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:08:14.420625 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-d5c632a1-c2cd-40d9-ac85-b206bac84b5f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.630656 Sep 09 13:08:14.421245 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1283 bytes} [Fri Sep 9 13:08:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 13:08:14.434800 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-a18243d0-091e-441f-8206-763294844f32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:14.467830 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-a18243d0-091e-441f-8206-763294844f32 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036890 Sep 09 13:08:14.468601 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1333 bytes} [Fri Sep 9 13:08:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:08:32.003606 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-d5c632a1-c2cd-40d9-ac85-b206bac84b5f admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:32.004624 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-d5c632a1-c2cd-40d9-ac85-b206bac84b5f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 09 13:08:32.005026 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 13:08:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:32.016522 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:08:32.395966 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-d903115a-61c1-457d-8338-3ac40199c45b admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:32.415173 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-d903115a-61c1-457d-8338-3ac40199c45b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403833 Sep 09 13:08:32.415715 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1292 bytes} [Fri Sep 9 13:08:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:08:33.718922 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-d5c632a1-c2cd-40d9-ac85-b206bac84b5f admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:33.719950 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-d5c632a1-c2cd-40d9-ac85-b206bac84b5f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 09 13:08:33.720345 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 13:08:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:34.248410 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-64fa4c4d-fef4-47af-997e-b55cb4a5a6fc admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:34.253609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.wsgi [None req-64fa4c4d-fef4-47af-997e-b55cb4a5a6fc admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-64fa4c4d-fef4-47af-997e-b55cb4a5a6fc admin admin] Request method failure captured: Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Accept: application/json Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Accept-Encoding: gzip, deflate Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Connection: keep-alive Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Content-Length: 0 Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Host: 10.222.0.17 Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Openstack-Api-Version: compute 2.92 Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Openstack-System-Scope: None Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: User-Agent: python-novaclient Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Auth-Token: gAAAAABjGzrRAhPbqa0knv2EIZ-MsAY2sEVUpP6EVzYfRhdDAhCs9aMSra02hjKuPoDvPxPaLMCwDBWtxkY1pVQY8Iq7R0K8F7xZ2AVnLsDYVeOizl-vR1LxfTkRKf5WE-LnnwOFa7Kmc-ReD_9_2Fg70vLx5WaeHThY939-CYeeczffgSMiMRI Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Domain-Id: None Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Domain-Name: None Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Identity-Status: Confirmed Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Is-Admin-Project: True Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Project-Domain-Id: default Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Project-Domain-Name: Default Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Project-Id: 97408104e346493ebafc4d549d2257c4 Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Project-Name: admin Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Role: admin,member,reader Sep 09 13:08:34.256864 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Roles: admin,member,reader Sep 09 13:08:34.258608 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/97408104e346493ebafc4d549d2257c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97408104e346493ebafc4d549d2257c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97408104e346493ebafc4d549d2257c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_97408104e346493ebafc4d549d2257c4", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:08:34.258608 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Tenant: admin Sep 09 13:08:34.258608 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Tenant-Id: 97408104e346493ebafc4d549d2257c4 Sep 09 13:08:34.258608 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Tenant-Name: admin Sep 09 13:08:34.258608 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User: admin Sep 09 13:08:34.258608 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User-Domain-Id: default Sep 09 13:08:34.258608 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User-Domain-Name: Default Sep 09 13:08:34.258608 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User-Id: a4f7da3ad6214b7b94cd5b55e583b917 Sep 09 13:08:34.258608 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User-Name: admin Sep 09 13:08:34.258608 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: method: > Sep 09 13:08:34.258608 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: exception: Flavor 42 could not be found. Sep 09 13:08:34.258608 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: action_args: {'id': '42'} Sep 09 13:08:34.258608 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:08:34.258608 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:34.259609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:34.260738 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-64fa4c4d-fef4-47af-997e-b55cb4a5a6fc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:08:34.261793 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-64fa4c4d-fef4-47af-997e-b55cb4a5a6fc admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.399353 Sep 09 13:08:34.261793 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Fri Sep 9 13:08:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 13:08:34.268348 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-beffd86f-6fba-4359-95b0-d67cb6387ade admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:34.290884 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-beffd86f-6fba-4359-95b0-d67cb6387ade admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026113 Sep 09 13:08:34.291462 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 9 13:08:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:08:34.302609 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-f89beace-6367-40be-aa6f-d1e449d44241 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:34.325669 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-f89beace-6367-40be-aa6f-d1e449d44241 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027076 Sep 09 13:08:34.326221 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 9 13:08:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:08:34.335973 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-bed5a2ce-f4f2-43d3-92f5-bb759ee34589 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:34.341901 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.wsgi [None req-bed5a2ce-f4f2-43d3-92f5-bb759ee34589 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-bed5a2ce-f4f2-43d3-92f5-bb759ee34589 admin admin] Request method failure captured: Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Accept: application/json Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Accept-Encoding: gzip, deflate Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Connection: keep-alive Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Content-Length: 0 Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Host: 10.222.0.17 Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Openstack-Api-Version: compute 2.92 Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Openstack-System-Scope: None Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: User-Agent: python-novaclient Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Auth-Token: gAAAAABjGzrRAhPbqa0knv2EIZ-MsAY2sEVUpP6EVzYfRhdDAhCs9aMSra02hjKuPoDvPxPaLMCwDBWtxkY1pVQY8Iq7R0K8F7xZ2AVnLsDYVeOizl-vR1LxfTkRKf5WE-LnnwOFa7Kmc-ReD_9_2Fg70vLx5WaeHThY939-CYeeczffgSMiMRI Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Domain-Id: None Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Domain-Name: None Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Identity-Status: Confirmed Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Is-Admin-Project: True Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Project-Domain-Id: default Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Project-Domain-Name: Default Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Project-Id: 97408104e346493ebafc4d549d2257c4 Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Project-Name: admin Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Role: admin,member,reader Sep 09 13:08:34.345232 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Roles: admin,member,reader Sep 09 13:08:34.346762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/97408104e346493ebafc4d549d2257c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97408104e346493ebafc4d549d2257c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97408104e346493ebafc4d549d2257c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_97408104e346493ebafc4d549d2257c4", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:08:34.346762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Tenant: admin Sep 09 13:08:34.346762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Tenant-Id: 97408104e346493ebafc4d549d2257c4 Sep 09 13:08:34.346762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Tenant-Name: admin Sep 09 13:08:34.346762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User: admin Sep 09 13:08:34.346762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User-Domain-Id: default Sep 09 13:08:34.346762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User-Domain-Name: Default Sep 09 13:08:34.346762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User-Id: a4f7da3ad6214b7b94cd5b55e583b917 Sep 09 13:08:34.346762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User-Name: admin Sep 09 13:08:34.346762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: method: > Sep 09 13:08:34.346762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: exception: Flavor 42 could not be found. Sep 09 13:08:34.346762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: action_args: {'id': '42'} Sep 09 13:08:34.346762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:08:34.346762 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:34.347783 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:34.349122 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-bed5a2ce-f4f2-43d3-92f5-bb759ee34589 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:08:34.350508 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-bed5a2ce-f4f2-43d3-92f5-bb759ee34589 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014467 Sep 09 13:08:34.350508 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Fri Sep 9 13:08:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 13:08:35.567383 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-f89beace-6367-40be-aa6f-d1e449d44241 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:35.568430 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-f89beace-6367-40be-aa6f-d1e449d44241 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 09 13:08:35.568824 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 13:08:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:36.092654 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-f81dfd5d-9dc3-49d6-a313-fd3348ad66fc admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:36.097740 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.wsgi [None req-f81dfd5d-9dc3-49d6-a313-fd3348ad66fc admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-f81dfd5d-9dc3-49d6-a313-fd3348ad66fc admin admin] Request method failure captured: Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Accept: application/json Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Accept-Encoding: gzip, deflate Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Connection: keep-alive Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Content-Length: 0 Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Host: 10.222.0.17 Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Openstack-Api-Version: compute 2.92 Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Openstack-System-Scope: None Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: User-Agent: python-novaclient Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Auth-Token: gAAAAABjGzrTNQEzqYXPoqmqeyZU0l3Ev9yjOuCW-BV3d_Z7_MXUlBj6h6ZdsfaZdAloKrt8-poQzvmiQttrCGodLE56X6iaSyXMMRD3FATOVvV1qMNXyPEwcHSvR7NK7FhIKHADCQENG-yigP2__p5ijrgZw0nUFJ7eHOBEiuKd7hQ90P9HHuA Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Domain-Id: None Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Domain-Name: None Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Identity-Status: Confirmed Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Is-Admin-Project: True Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Project-Domain-Id: default Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Project-Domain-Name: Default Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Project-Id: 97408104e346493ebafc4d549d2257c4 Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Project-Name: admin Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Role: admin,member,reader Sep 09 13:08:36.099282 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Roles: admin,member,reader Sep 09 13:08:36.100802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/97408104e346493ebafc4d549d2257c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97408104e346493ebafc4d549d2257c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97408104e346493ebafc4d549d2257c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_97408104e346493ebafc4d549d2257c4", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:08:36.100802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Tenant: admin Sep 09 13:08:36.100802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Tenant-Id: 97408104e346493ebafc4d549d2257c4 Sep 09 13:08:36.100802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Tenant-Name: admin Sep 09 13:08:36.100802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User: admin Sep 09 13:08:36.100802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User-Domain-Id: default Sep 09 13:08:36.100802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User-Domain-Name: Default Sep 09 13:08:36.100802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User-Id: a4f7da3ad6214b7b94cd5b55e583b917 Sep 09 13:08:36.100802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User-Name: admin Sep 09 13:08:36.100802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: method: > Sep 09 13:08:36.100802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: exception: Flavor 84 could not be found. Sep 09 13:08:36.100802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: action_args: {'id': '84'} Sep 09 13:08:36.100802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:08:36.100802 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:36.101659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:36.103119 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-f81dfd5d-9dc3-49d6-a313-fd3348ad66fc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:08:36.104413 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-f81dfd5d-9dc3-49d6-a313-fd3348ad66fc admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.394522 Sep 09 13:08:36.104413 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Fri Sep 9 13:08:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 13:08:36.110761 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-6a7b91f5-ba04-44f2-a54b-12d8a9690f8a admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:36.126208 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-6a7b91f5-ba04-44f2-a54b-12d8a9690f8a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019303 Sep 09 13:08:36.126730 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 9 13:08:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:08:36.136049 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-4c3cd19a-e722-4a35-97d4-c40d90f877df admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:36.151615 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-4c3cd19a-e722-4a35-97d4-c40d90f877df admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019098 Sep 09 13:08:36.152150 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 9 13:08:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:08:36.161133 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-2ec96fdc-3575-4724-a97f-59de8527bc40 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:36.166005 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.wsgi [None req-2ec96fdc-3575-4724-a97f-59de8527bc40 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-2ec96fdc-3575-4724-a97f-59de8527bc40 admin admin] Request method failure captured: Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Accept: application/json Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Accept-Encoding: gzip, deflate Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Connection: keep-alive Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Content-Length: 0 Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Host: 10.222.0.17 Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Openstack-Api-Version: compute 2.92 Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Openstack-System-Scope: None Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: User-Agent: python-novaclient Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Auth-Token: gAAAAABjGzrTNQEzqYXPoqmqeyZU0l3Ev9yjOuCW-BV3d_Z7_MXUlBj6h6ZdsfaZdAloKrt8-poQzvmiQttrCGodLE56X6iaSyXMMRD3FATOVvV1qMNXyPEwcHSvR7NK7FhIKHADCQENG-yigP2__p5ijrgZw0nUFJ7eHOBEiuKd7hQ90P9HHuA Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Domain-Id: None Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Domain-Name: None Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Identity-Status: Confirmed Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Is-Admin-Project: True Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Project-Domain-Id: default Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Project-Domain-Name: Default Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Project-Id: 97408104e346493ebafc4d549d2257c4 Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Project-Name: admin Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Role: admin,member,reader Sep 09 13:08:36.167530 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Roles: admin,member,reader Sep 09 13:08:36.169137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/97408104e346493ebafc4d549d2257c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97408104e346493ebafc4d549d2257c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97408104e346493ebafc4d549d2257c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_97408104e346493ebafc4d549d2257c4", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:08:36.169137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Tenant: admin Sep 09 13:08:36.169137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Tenant-Id: 97408104e346493ebafc4d549d2257c4 Sep 09 13:08:36.169137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Tenant-Name: admin Sep 09 13:08:36.169137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User: admin Sep 09 13:08:36.169137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User-Domain-Id: default Sep 09 13:08:36.169137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User-Domain-Name: Default Sep 09 13:08:36.169137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User-Id: a4f7da3ad6214b7b94cd5b55e583b917 Sep 09 13:08:36.169137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User-Name: admin Sep 09 13:08:36.169137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: method: > Sep 09 13:08:36.169137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: exception: Flavor 84 could not be found. Sep 09 13:08:36.169137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: action_args: {'id': '84'} Sep 09 13:08:36.169137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:08:36.169137 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:36.170148 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:36.171536 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-2ec96fdc-3575-4724-a97f-59de8527bc40 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:08:36.172829 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-2ec96fdc-3575-4724-a97f-59de8527bc40 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011239 Sep 09 13:08:36.172829 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Fri Sep 9 13:08:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 13:08:37.391336 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-4c3cd19a-e722-4a35-97d4-c40d90f877df admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:37.392329 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-4c3cd19a-e722-4a35-97d4-c40d90f877df admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 09 13:08:37.392717 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 13:08:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:37.914978 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-4cafbf6d-7a68-48be-9c4d-ca790e8a58a4 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:37.921472 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.wsgi [None req-4cafbf6d-7a68-48be-9c4d-ca790e8a58a4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-4cafbf6d-7a68-48be-9c4d-ca790e8a58a4 admin admin] Request method failure captured: Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Accept: application/json Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Accept-Encoding: gzip, deflate Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Connection: keep-alive Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Content-Length: 0 Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Host: 10.222.0.17 Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Openstack-Api-Version: compute 2.92 Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Openstack-System-Scope: None Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: User-Agent: python-novaclient Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Auth-Token: gAAAAABjGzrVQB05rERuUcFweFbAi969Al1JeIBU4Jjhx1a-0e6SRJKfIUTNy5BgZQTSl1jcIDOtvzRXz3j--pwlqyqLJaVixiKE--hTIbXgPgqqsFCshabu3NH9lRX99wpxXJF1QCTJRKbgIyFntgMmHhAQBRLsp_iLMUMW7LIEdnQokPnXpaQ Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Domain-Id: None Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Domain-Name: None Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Identity-Status: Confirmed Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Is-Admin-Project: True Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Project-Domain-Id: default Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Project-Domain-Name: Default Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Project-Id: 97408104e346493ebafc4d549d2257c4 Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Project-Name: admin Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Role: admin,member,reader Sep 09 13:08:37.922986 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Roles: admin,member,reader Sep 09 13:08:37.924592 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/97408104e346493ebafc4d549d2257c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97408104e346493ebafc4d549d2257c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97408104e346493ebafc4d549d2257c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_97408104e346493ebafc4d549d2257c4", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:08:37.924592 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Tenant: admin Sep 09 13:08:37.924592 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Tenant-Id: 97408104e346493ebafc4d549d2257c4 Sep 09 13:08:37.924592 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-Tenant-Name: admin Sep 09 13:08:37.924592 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User: admin Sep 09 13:08:37.924592 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User-Domain-Id: default Sep 09 13:08:37.924592 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User-Domain-Name: Default Sep 09 13:08:37.924592 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User-Id: a4f7da3ad6214b7b94cd5b55e583b917 Sep 09 13:08:37.924592 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: X-User-Name: admin Sep 09 13:08:37.924592 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: method: > Sep 09 13:08:37.924592 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: exception: Flavor 451 could not be found. Sep 09 13:08:37.924592 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: action_args: {'id': '451'} Sep 09 13:08:37.924592 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:08:37.924592 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:37.925483 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: ERROR nova.api.openstack.wsgi Sep 09 13:08:37.926547 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-4cafbf6d-7a68-48be-9c4d-ca790e8a58a4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:08:37.927595 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-4cafbf6d-7a68-48be-9c4d-ca790e8a58a4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.396835 Sep 09 13:08:37.927595 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 9 13:08:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 13:08:37.934449 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-22e095fc-9653-44db-9fd8-52d32c713503 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:37.949916 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-22e095fc-9653-44db-9fd8-52d32c713503 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019245 Sep 09 13:08:37.950612 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 9 13:08:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:08:37.960245 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-7cc109ae-789b-416c-840d-4f0d45c98ae1 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:37.975012 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-7cc109ae-789b-416c-840d-4f0d45c98ae1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018339 Sep 09 13:08:37.975568 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Fri Sep 9 13:08:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:08:37.986178 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-12cb6ab7-739f-4647-a15d-e312897c6bf5 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:37.992140 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.wsgi [None req-12cb6ab7-739f-4647-a15d-e312897c6bf5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-12cb6ab7-739f-4647-a15d-e312897c6bf5 admin admin] Request method failure captured: Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Accept: application/json Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Accept-Encoding: gzip, deflate Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Connection: keep-alive Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Content-Length: 0 Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Host: 10.222.0.17 Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Openstack-Api-Version: compute 2.92 Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Openstack-System-Scope: None Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: User-Agent: python-novaclient Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Auth-Token: gAAAAABjGzrVQB05rERuUcFweFbAi969Al1JeIBU4Jjhx1a-0e6SRJKfIUTNy5BgZQTSl1jcIDOtvzRXz3j--pwlqyqLJaVixiKE--hTIbXgPgqqsFCshabu3NH9lRX99wpxXJF1QCTJRKbgIyFntgMmHhAQBRLsp_iLMUMW7LIEdnQokPnXpaQ Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Domain-Id: None Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Domain-Name: None Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Identity-Status: Confirmed Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Is-Admin-Project: True Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Project-Domain-Id: default Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Project-Domain-Name: Default Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Project-Id: 97408104e346493ebafc4d549d2257c4 Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Project-Name: admin Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Role: admin,member,reader Sep 09 13:08:37.994437 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Roles: admin,member,reader Sep 09 13:08:37.996255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/97408104e346493ebafc4d549d2257c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97408104e346493ebafc4d549d2257c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/97408104e346493ebafc4d549d2257c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_97408104e346493ebafc4d549d2257c4", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:08:37.996255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Tenant: admin Sep 09 13:08:37.996255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Tenant-Id: 97408104e346493ebafc4d549d2257c4 Sep 09 13:08:37.996255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-Tenant-Name: admin Sep 09 13:08:37.996255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User: admin Sep 09 13:08:37.996255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User-Domain-Id: default Sep 09 13:08:37.996255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User-Domain-Name: Default Sep 09 13:08:37.996255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User-Id: a4f7da3ad6214b7b94cd5b55e583b917 Sep 09 13:08:37.996255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: X-User-Name: admin Sep 09 13:08:37.996255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: method: > Sep 09 13:08:37.996255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: exception: Flavor 451 could not be found. Sep 09 13:08:37.996255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: action_args: {'id': '451'} Sep 09 13:08:37.996255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:08:37.996255 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:37.997173 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: ERROR nova.api.openstack.wsgi Sep 09 13:08:37.999141 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-12cb6ab7-739f-4647-a15d-e312897c6bf5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:08:38.000492 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-12cb6ab7-739f-4647-a15d-e312897c6bf5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.014988 Sep 09 13:08:38.000492 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 9 13:08:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 13:08:39.228446 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-7cc109ae-789b-416c-840d-4f0d45c98ae1 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:39.229464 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-7cc109ae-789b-416c-840d-4f0d45c98ae1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 09 13:08:39.229849 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 13:08:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:39.754855 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-53535c1d-a873-460b-b7e6-ac8f04de8dfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:39.774047 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-53535c1d-a873-460b-b7e6-ac8f04de8dfc admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.405533 Sep 09 13:08:39.774589 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Fri Sep 9 13:08:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:08:41.000650 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-7cc109ae-789b-416c-840d-4f0d45c98ae1 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:41.001659 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-7cc109ae-789b-416c-840d-4f0d45c98ae1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002092 Sep 09 13:08:41.002052 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 13:08:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:41.525638 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-c197649c-fccb-49ba-9faf-c595c410aedf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:41.544151 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-c197649c-fccb-49ba-9faf-c595c410aedf admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.403321 Sep 09 13:08:41.544701 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Fri Sep 9 13:08:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:08:42.783196 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-7cc109ae-789b-416c-840d-4f0d45c98ae1 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:42.784265 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-7cc109ae-789b-416c-840d-4f0d45c98ae1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 09 13:08:42.784659 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 13:08:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:43.307722 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-ed2f7d78-2857-4bb3-9ca6-ab80012ce083 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:43.327207 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-ed2f7d78-2857-4bb3-9ca6-ab80012ce083 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.404124 Sep 09 13:08:43.327736 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Fri Sep 9 13:08:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:08:44.557938 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-7cc109ae-789b-416c-840d-4f0d45c98ae1 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:44.558947 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-7cc109ae-789b-416c-840d-4f0d45c98ae1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 09 13:08:44.559391 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 13:08:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:45.093190 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-a2b75e0d-88fd-4a97-8d3a-dcbea6fc34cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:08:45.113433 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-a2b75e0d-88fd-4a97-8d3a-dcbea6fc34cb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.412601 Sep 09 13:08:45.113983 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Fri Sep 9 13:08:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:08:46.336652 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-7cc109ae-789b-416c-840d-4f0d45c98ae1 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:46.337684 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-7cc109ae-789b-416c-840d-4f0d45c98ae1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 09 13:08:46.338070 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 13:08:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:08:46.859017 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-18d27c77-7d0a-44fe-a068-3177fddf71bd admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:08:46.879228 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-18d27c77-7d0a-44fe-a068-3177fddf71bd admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403244 Sep 09 13:08:46.879764 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Fri Sep 9 13:08:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:09:43.757047 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-7cc109ae-789b-416c-840d-4f0d45c98ae1 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:09:43.758052 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-7cc109ae-789b-416c-840d-4f0d45c98ae1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 09 13:09:43.758446 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 931 bytes} [Fri Sep 9 13:09:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:09:43.769308 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:09:44.153089 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-0d15c2ba-5de5-4dbf-a61e-50761bfc614a admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:09:44.173955 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-0d15c2ba-5de5-4dbf-a61e-50761bfc614a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409665 Sep 09 13:09:44.174498 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1292 bytes} [Fri Sep 9 13:09:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:09:44.196127 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_api:SELECT=14 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:09:44.200230 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-09c1cb27-59a6-4a47-8221-4d6ee85af4c1 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:09:44.208524 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-09c1cb27-59a6-4a47-8221-4d6ee85af4c1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013813 Sep 09 13:09:44.209038 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1283 bytes} [Fri Sep 9 13:09:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:09:44.220871 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-48d1a2d8-e824-4b30-bf0c-f8f5fdf0c8c1 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:09:44.228078 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-48d1a2d8-e824-4b30-bf0c-f8f5fdf0c8c1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011021 Sep 09 13:09:44.228590 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1286 bytes} [Fri Sep 9 13:09:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:09:44.240246 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-d917be34-fda5-4946-9ad4-3814f44524e0 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:09:44.247363 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-d917be34-fda5-4946-9ad4-3814f44524e0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010634 Sep 09 13:09:44.247874 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1286 bytes} [Fri Sep 9 13:09:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:09:44.259545 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-49a59553-4e35-42bf-85cd-1d5c5b75f60c admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:09:44.266728 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-49a59553-4e35-42bf-85cd-1d5c5b75f60c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010713 Sep 09 13:09:44.267307 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1283 bytes} [Fri Sep 9 13:09:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:12:40.814259 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-d917be34-fda5-4946-9ad4-3814f44524e0 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:12:40.815312 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-d917be34-fda5-4946-9ad4-3814f44524e0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 09 13:12:40.815711 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 13:12:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:12:40.956364 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:SELECT=6 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:41.114866 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-13b8661a-73c1-4636-9896-9e4bc4868835 admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:12:41.119684 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-13b8661a-73c1-4636-9896-9e4bc4868835 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:12:41.120152 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-13b8661a-73c1-4636-9896-9e4bc4868835 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:12:41.120574 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-13b8661a-73c1-4636-9896-9e4bc4868835 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:12:41.121272 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-13b8661a-73c1-4636-9896-9e4bc4868835 admin admin] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:12:41.121708 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-13b8661a-73c1-4636-9896-9e4bc4868835 admin admin] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:12:41.122112 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-13b8661a-73c1-4636-9896-9e4bc4868835 admin admin] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:12:41.153697 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-13b8661a-73c1-4636-9896-9e4bc4868835 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.198495 Sep 09 13:12:41.154238 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 9 13:12:40 2022] GET /compute/v2.1/os-services => generated 794 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:12:42.257595 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-d917be34-fda5-4946-9ad4-3814f44524e0 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:12:42.258657 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-d917be34-fda5-4946-9ad4-3814f44524e0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Sep 09 13:12:42.259072 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 13:12:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:12:42.450298 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-bd575067-36ac-4773-aba8-c9b7a806c90e admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:12:42.453702 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-bd575067-36ac-4773-aba8-c9b7a806c90e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:12:42.454196 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-bd575067-36ac-4773-aba8-c9b7a806c90e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:12:42.454610 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-bd575067-36ac-4773-aba8-c9b7a806c90e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:12:42.455336 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-bd575067-36ac-4773-aba8-c9b7a806c90e admin admin] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:12:42.455772 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-bd575067-36ac-4773-aba8-c9b7a806c90e admin admin] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:12:42.456172 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-bd575067-36ac-4773-aba8-c9b7a806c90e admin admin] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:12:42.475803 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-bd575067-36ac-4773-aba8-c9b7a806c90e admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.076830 Sep 09 13:12:42.476336 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 9 13:12:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:12:53.960076 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-d917be34-fda5-4946-9ad4-3814f44524e0 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:12:53.961076 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-d917be34-fda5-4946-9ad4-3814f44524e0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Sep 09 13:12:53.961472 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 13:12:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:12:54.105955 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell0:SELECT=4 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:54.106648 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_cell1:SELECT=4 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:54.107297 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG dbcounter [-] [105611] Writing DB stats nova_api:SELECT=8 {{(pid=105611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:12:54.155120 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-27af4cc2-b5a2-4814-8e83-b911ef2cff4e admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:12:54.158474 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-27af4cc2-b5a2-4814-8e83-b911ef2cff4e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:12:54.158945 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-27af4cc2-b5a2-4814-8e83-b911ef2cff4e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:12:54.159422 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-27af4cc2-b5a2-4814-8e83-b911ef2cff4e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:12:54.160132 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-27af4cc2-b5a2-4814-8e83-b911ef2cff4e admin admin] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:12:54.160579 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-27af4cc2-b5a2-4814-8e83-b911ef2cff4e admin admin] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:12:54.160993 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-27af4cc2-b5a2-4814-8e83-b911ef2cff4e admin admin] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:12:54.186741 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-27af4cc2-b5a2-4814-8e83-b911ef2cff4e admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.085544 Sep 09 13:12:54.187326 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 9 13:12:54 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:12:55.274316 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG nova.api.openstack.wsgi [None req-d917be34-fda5-4946-9ad4-3814f44524e0 admin admin] Calling method '>' {{(pid=105612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:12:55.275347 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: INFO nova.api.openstack.requestlog [None req-d917be34-fda5-4946-9ad4-3814f44524e0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Sep 09 13:12:55.275747 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: [pid: 105612|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Fri Sep 9 13:12:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:12:55.466790 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG nova.api.openstack.wsgi [None req-a6436fd9-d2af-4da8-b3c1-7218a9b26cef admin admin] Calling method '>' {{(pid=105611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:12:55.470186 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-a6436fd9-d2af-4da8-b3c1-7218a9b26cef admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:12:55.470659 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-a6436fd9-d2af-4da8-b3c1-7218a9b26cef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:12:55.471123 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-a6436fd9-d2af-4da8-b3c1-7218a9b26cef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:12:55.471897 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-a6436fd9-d2af-4da8-b3c1-7218a9b26cef admin admin] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:12:55.472341 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-a6436fd9-d2af-4da8-b3c1-7218a9b26cef admin admin] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:12:55.472754 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: DEBUG oslo_concurrency.lockutils [None req-a6436fd9-d2af-4da8-b3c1-7218a9b26cef admin admin] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:12:55.494505 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: INFO nova.api.openstack.requestlog [None req-a6436fd9-d2af-4da8-b3c1-7218a9b26cef admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.078839 Sep 09 13:12:55.494987 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: [pid: 105611|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Fri Sep 9 13:12:55 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:13:52.232531 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: Fri Sep 9 13:13:52 2022 - graceful shutdown triggered... Sep 09 13:13:52.232253 dv-cinder-831247-26-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 09 13:13:52.233733 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: Gracefully killing worker 2 (pid: 105612)... Sep 09 13:13:52.234188 dv-cinder-831247-26-iscsi devstack@n-api.service[105611]: Gracefully killing worker 1 (pid: 105611)... Sep 09 13:13:52.361841 dv-cinder-831247-26-iscsi devstack@n-api.service[105612]: DEBUG dbcounter [-] [105612] Writing DB stats nova_api:SELECT=4 {{(pid=105612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:13:53.233335 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: worker 1 buried after 1 seconds Sep 09 13:13:53.233335 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: worker 2 buried after 1 seconds Sep 09 13:13:53.233335 dv-cinder-831247-26-iscsi devstack@n-api.service[105610]: goodbye to uWSGI. Sep 09 13:13:53.234794 dv-cinder-831247-26-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 09 13:13:53.235378 dv-cinder-831247-26-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 09 13:13:53.238225 dv-cinder-831247-26-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 13:13:53.248467 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 13:13:53.250476 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 13:13:53 2022] *** Sep 09 13:13:53.250476 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 13:13:53.250476 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 13:13:53.250476 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: nodename: dv-cinder-831247-26-iscsi Sep 09 13:13:53.250476 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: machine: x86_64 Sep 09 13:13:53.250476 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: clock source: unix Sep 09 13:13:53.250476 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: pcre jit disabled Sep 09 13:13:53.250476 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: detected number of CPU cores: 4 Sep 09 13:13:53.250476 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: current working directory: / Sep 09 13:13:53.250476 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: detected binary path: /usr/bin/uwsgi-core Sep 09 13:13:53.251240 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: your processes number limit is 47680 Sep 09 13:13:53.251240 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: your memory page size is 4096 bytes Sep 09 13:13:53.251240 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: detected max file descriptor number: 2048 Sep 09 13:13:53.251240 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: lock engine: pthread robust mutexes Sep 09 13:13:53.251240 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: thunder lock: enabled Sep 09 13:13:53.251240 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 13:13:53.251240 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 13:13:53.290926 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: Python main interpreter initialized at 0x560e446299c0 Sep 09 13:13:53.290926 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: python threads support enabled Sep 09 13:13:53.290926 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: your server socket listen backlog is limited to 100 connections Sep 09 13:13:53.290926 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: your mercy for graceful operations on workers is 90 seconds Sep 09 13:13:53.291530 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 13:13:53.291530 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: *** Operational MODE: preforking *** Sep 09 13:13:53.291699 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: *** uWSGI is running in multiple interpreter mode *** Sep 09 13:13:53.291699 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: spawned uWSGI master process (pid: 120609) Sep 09 13:13:53.294309 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: spawned uWSGI worker 1 (pid: 120623, cores: 1) Sep 09 13:13:53.294309 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: spawned uWSGI worker 2 (pid: 120625, cores: 1) Sep 09 13:13:53.294309 dv-cinder-831247-26-iscsi devstack@n-api.service[120609]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 13:13:53.291989 dv-cinder-831247-26-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 13:13:53.955183 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 13:13:53.964737 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 13:13:55.117126 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 13:13:55.117126 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: from cryptography.utils import int_from_bytes Sep 09 13:13:55.117704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 13:13:55.117704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: from cryptography.utils import int_from_bytes Sep 09 13:13:55.124467 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 13:13:55.124467 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: from cryptography.utils import int_from_bytes Sep 09 13:13:55.124953 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 13:13:55.124953 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: from cryptography.utils import int_from_bytes Sep 09 13:13:57.536133 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 13:13:57.536751 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 13:13:57.536933 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 13:13:57.537302 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 13:13:57.537559 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 13:13:57.537952 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.538281 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.538606 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.538927 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.539287 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.539607 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.539934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.540256 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.540586 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.540851 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.541173 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.542188 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-26-iscsi {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.542542 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.543014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.543377 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.543723 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.544045 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.544349 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.544665 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.544844 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 13:13:57.545245 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 13:13:57.545333 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.546766 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 13:13:57.546908 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.546908 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.547100 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 13:13:57.547100 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 13:13:57.547254 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.547254 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.547390 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.547478 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.547557 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.547628 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.547703 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.547780 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.547861 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.547942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.548021 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.548092 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.548162 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.548501 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.548631 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.548829 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.548948 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-26-iscsi {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.549144 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.549264 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.549351 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.549425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.549645 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.549768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.550103 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-26-iscsi {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.550230 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.550515 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.550686 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.550928 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.551023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.551449 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.551558 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.551650 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.551732 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.551817 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.551896 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.551988 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.552242 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.552417 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.552598 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.552831 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.552995 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.553103 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.553317 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.553480 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.553669 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.553788 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.554025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.554141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.554361 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.554473 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.554671 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.554785 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.554982 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.555157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.555315 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.555662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.555662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.555970 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.556077 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.556211 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.556343 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.563574 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-26-iscsi {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.563738 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.563839 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.563943 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.564045 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.564045 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.564045 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.564045 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.564382 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.564479 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.564726 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.564825 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.564919 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.565005 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.565005 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.565240 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.565452 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.565554 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.565640 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.565809 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.565905 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.565997 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.566083 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.566178 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.566270 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.566369 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.566462 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.566555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.566650 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.566734 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.566825 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.566922 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.567009 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.567110 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.567878 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.568066 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.568173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.568274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.568368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.568453 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.568537 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.568628 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.568781 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.568922 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.569024 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.569120 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.569205 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.569298 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.569415 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.569564 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.569706 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.569839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.569981 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.570130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.570403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.570502 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.570597 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.570597 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.570881 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.571097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.571207 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.571303 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.571389 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.571524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.571653 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.571758 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.571844 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.571936 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.572032 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.572201 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.572355 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.572355 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.572683 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.573043 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.573207 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.573449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.573554 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.573648 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.573734 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.573819 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.573911 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.574048 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.574153 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.574251 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.574337 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.574481 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.574579 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.574671 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.574770 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.574856 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.575010 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.575123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.575574 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.575679 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.575784 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.575872 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.575956 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.576047 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.576139 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.576234 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.576416 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.576522 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.576617 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.577052 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.577188 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.577370 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.577553 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.577813 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.577923 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.578034 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.578126 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.578251 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.578410 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.578515 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.578610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.578707 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.578889 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.579235 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.579349 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.579439 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.579542 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.579636 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.579731 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.579913 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.580009 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.580009 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.580186 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.580273 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.580365 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.580365 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.580576 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.580666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.580763 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.580849 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.580941 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.581033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.581117 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.581210 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.581295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.581386 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.581478 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.581572 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.581707 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.581808 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.581902 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.582002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.582089 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.582183 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.582276 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.582371 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.582457 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.582542 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.582643 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.582737 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.582829 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.582914 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.583004 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.583106 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.583211 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.583347 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.583446 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.583532 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.583617 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.583761 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.583859 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.583859 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.584023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.584157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.584248 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.584461 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.584608 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.584766 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.584861 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.585084 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.585196 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.585383 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.585484 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.585687 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.585784 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.586001 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.586095 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.586304 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.586413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.586605 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.586706 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.586915 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.587081 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.587267 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.587371 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.587571 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.587684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.587876 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.588054 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.588175 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.588330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.588500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.588798 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.588966 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.589241 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.589341 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.589427 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.589520 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.589721 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.589825 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.590026 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.590181 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.590324 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.590468 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.590625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 13:13:57.590963 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.591320 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.591491 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.591662 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.591885 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.592047 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.592284 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.592446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.592615 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.592775 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.592923 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.593086 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.593243 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.593399 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.593545 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.593832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.594000 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.594154 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.594310 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.594465 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.594728 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.594888 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.595034 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.595209 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.595390 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.595590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.595751 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.596120 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.596226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.596442 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.596555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.596761 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.596900 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.597079 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.597213 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.597397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.597501 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.597727 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.597860 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.598049 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.598358 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.598700 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.598808 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.599065 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.599175 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.599379 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.599474 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.599703 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.599808 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.600035 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.600282 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.600387 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.600474 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.600725 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.600869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.601640 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.601737 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.601737 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.601950 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.602307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.602481 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.602640 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.602795 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.602943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.603249 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.603422 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.603580 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.603580 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.603868 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.604555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.604747 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.604915 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.605062 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.605246 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.605438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.605585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.605731 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.605951 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.606106 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.606262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.606408 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.606575 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.606744 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.606900 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.607068 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.607224 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.607391 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.607539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.607694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.607839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.607993 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.608459 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.608625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.608812 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.608979 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.609287 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.609449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.609596 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.609741 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.609886 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.610043 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.610369 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.610542 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.610542 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.610838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.611159 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.611323 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.611478 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.611625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.611771 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.611916 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.612073 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.612220 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.612365 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.612520 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.612673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.612820 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.612975 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.613133 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.613280 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.613440 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.613587 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.613744 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.613900 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.614047 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.614047 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.614813 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.614920 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.615017 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.615759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.615759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.615984 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.616075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.616182 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.616279 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.616373 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.616460 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.616552 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.616645 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.616745 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.616839 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.616925 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.617011 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.617104 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.617190 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.617447 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.617542 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.617756 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.617857 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.618063 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.618171 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.618387 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.618491 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.618698 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.618793 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.619007 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.619249 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.619381 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.619580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.620289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.620510 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.620646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.620914 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.621030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.621150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.621244 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.621465 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.621563 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.621774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.621869 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.622108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.622201 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.622412 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.622575 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.622717 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.622820 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.623016 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.623177 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.623416 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.623522 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.623724 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.623817 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.624029 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.624129 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.624334 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.624444 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.624639 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.624733 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.624943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.625086 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.625265 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.625446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.625573 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.625799 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.625937 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.626162 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.626275 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.626463 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.626568 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.626800 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.626893 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.627135 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.627252 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.627455 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.627563 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.627774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.627909 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.628093 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.628221 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.628409 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.628520 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.628723 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.628820 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.629141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.629255 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.629458 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.629728 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.629827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.630156 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.630481 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.630814 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.630905 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.631181 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.631297 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.631509 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.631621 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.631820 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.631928 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.632151 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.632260 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.632487 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.632616 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.632850 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.632963 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.633179 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.633559 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.633999 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.634221 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.634342 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.634420 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.634715 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.634842 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.634932 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.635031 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.636019 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.636163 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.636245 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.636429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.636637 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.636741 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.637028 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.637139 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.637288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.637391 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.637553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.637656 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.637880 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.638060 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.638210 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.638357 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.638514 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.638661 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.638809 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.638963 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.639172 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.639328 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.639488 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.639637 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.639791 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.639945 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.640114 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.640325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.640500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.640649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.640803 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.640950 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.641097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.641262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.641418 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.641566 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.641722 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.641869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.642025 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.642197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.642353 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.642510 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.642760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.642932 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.643196 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.643367 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.643525 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.643672 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.643829 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.643984 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.644131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.644286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.644459 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.644617 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.644925 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.645083 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.645258 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.645408 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.645555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.645703 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.645849 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.646101 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.646340 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.646492 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.646639 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.646804 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.646968 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.647284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.647454 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.647611 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.647759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.647913 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.648060 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.648214 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.648371 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.648526 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.648681 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.648839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.648994 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.649155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.649302 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.649459 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.649614 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.649761 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.649917 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.649917 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.650248 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.650409 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.650557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.650703 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.651493 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.651674 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.651825 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.651973 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.652130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.652285 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.652432 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.652663 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.652907 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.653062 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.653309 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.653471 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.653633 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.653811 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.653969 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.654119 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.654265 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.654412 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.654569 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.654717 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.655036 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.655213 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.655360 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.655507 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.655681 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.655840 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.656007 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.656244 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.656482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.656651 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.656811 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.656960 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.657108 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.657400 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.657553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.657712 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.657860 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.658015 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.658176 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.658597 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.658752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.658914 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.658914 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.659302 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.659577 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.659730 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.659885 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.659885 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.660184 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.660340 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.660489 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.660647 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.660804 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.660953 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.661110 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.661258 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.661421 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.661576 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.661732 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.661887 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.662035 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.662181 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.662343 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.662503 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.662669 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.662839 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.663092 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.663279 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.663520 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.663680 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.663831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.663987 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.664136 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.664282 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.664436 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.664436 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.664747 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.664905 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.665181 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.665334 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.665482 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.665638 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.665802 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.665960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.666115 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.666379 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.666641 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.666804 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.666987 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.667239 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.667537 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.667703 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.667860 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.667860 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.668159 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.668315 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.668463 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.668609 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.668766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.668915 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.669076 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.669076 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.669373 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.669545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.669768 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.669921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.670084 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.670232 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.670386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.670548 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.670697 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.670858 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.671006 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.671006 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.671326 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.671484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.671632 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.671789 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.671938 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.672085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.672240 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.672388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.672535 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.672692 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.672848 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.672996 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.673244 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.673408 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.673654 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.673808 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.673966 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.674121 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.674270 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.674425 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.674583 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.674739 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.674894 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.675077 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.675340 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.675494 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.675663 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.675811 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.675973 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.676123 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.676276 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.676460 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.676811 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.676968 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.677125 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.677272 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.677420 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.677735 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.677887 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.678054 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.678212 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.678360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.678515 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.678673 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.678829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.678984 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.679158 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.679307 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.679454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.679618 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.679793 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.680020 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.680183 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.680331 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.680478 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.680636 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.680785 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.680932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.681078 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.681224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.681386 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.681545 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.681692 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.681855 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.682020 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.682748 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.682996 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.683230 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.683474 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.683661 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.683912 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.684086 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.684272 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.684430 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.684584 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.684746 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.684901 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.685066 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.685321 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.685576 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.685738 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.685900 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.686062 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.686231 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.686231 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.686535 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.686708 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.687024 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.687215 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.687385 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.687385 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.687858 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.688025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.688180 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.688349 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.688519 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.688684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.688684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.688975 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.689136 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.689290 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.689455 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.689617 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.689790 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.689954 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.690197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.690373 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.690529 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.690689 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.690851 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.691005 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.691211 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.691379 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.691534 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.691696 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.691852 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.692026 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.692181 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.692344 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.692498 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.692707 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.692707 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.693021 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.693177 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.693409 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.693657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.693816 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.694063 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.694236 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.694402 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.694556 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.694556 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.694854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.694854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.695174 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.695342 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.695509 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.695765 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.695934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.696090 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.696243 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.696423 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.696578 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.696739 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.697062 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.697224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.697378 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.697543 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.697739 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.698583 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.698778 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.698952 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.699154 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.699346 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.699538 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.699702 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.699857 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.700019 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.700204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.700442 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.700603 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.700776 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.701453 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.701628 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.701800 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.701955 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.702118 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.702289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.702452 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.702614 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.702782 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.702936 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.703120 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.703289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.703451 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.703613 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.703613 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.704038 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.704266 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.704425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.704590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.704759 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.704922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.705087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.705251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.705251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.705560 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.705724 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.705878 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.706041 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.706041 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.706357 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.706629 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.706801 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.706956 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.707311 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.707484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.707648 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.707803 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.707989 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.708222 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.708383 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.708623 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.708791 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.708955 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.709134 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.709298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.709298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.709590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.709590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.709904 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.710066 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.710229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.710384 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.710630 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.710796 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.710962 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.711152 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.711321 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.711482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.711651 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.711817 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.711981 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.712144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.712308 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.712308 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.712599 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.712599 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.712909 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.713063 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.713216 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.713444 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.713606 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.713777 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.714027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.714195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.714440 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.714440 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.714750 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.714916 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.715092 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.715253 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.715418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.715592 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.715748 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.715913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.716068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.716221 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.716375 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.716537 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.716821 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.716985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.717148 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.717471 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.717642 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.717798 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.717977 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.718133 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.718390 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.718558 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.718802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.718971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.719257 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.719415 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.719569 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.719735 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.719974 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.720133 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.720288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.720463 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.720646 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.720892 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.721065 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.721222 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.721384 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.721539 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.721693 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.721855 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.722020 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.722176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.722331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.722498 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.722660 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.722823 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.722993 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.723173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.723341 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.723504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.723667 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.723838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.724021 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.724253 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.724441 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.724669 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.724847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.725018 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.725174 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.725338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.725494 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.725648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.725809 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.725973 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.726129 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.726283 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.726439 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.726593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.726758 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.727043 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.727240 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.727419 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.727739 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.727895 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.728065 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.728219 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.728401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.728644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.728831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.729104 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.729277 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.729444 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.729444 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.729739 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.729892 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.730123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.730293 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.730457 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.730613 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.730766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.731038 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.731255 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.731411 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.731573 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.731751 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.731916 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.732071 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.732234 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.732398 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.732553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.732715 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.732878 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.733040 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.733474 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.733638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.733793 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.733958 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.734123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.734305 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.734547 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.734803 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.734963 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.735141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.735298 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.735470 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.735640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.735805 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.735959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.736114 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.736276 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.736464 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.736619 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.736781 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.736945 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.737216 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.737384 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.737568 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.737884 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.738062 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.738227 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.738392 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.738548 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.738821 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.738983 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.739234 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.739395 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.739568 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.739734 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.739734 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.740046 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.740201 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.740362 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.740517 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.740686 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.740842 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.741100 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.741273 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.741435 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.741598 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.741767 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.741931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.742095 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.742266 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.742428 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.742593 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.742757 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.742921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.743096 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.743278 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.743435 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.743603 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.743759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.743922 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.744076 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.744231 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.744385 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.745238 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.745411 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.745567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.745720 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.745886 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.746055 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.746225 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.746381 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.746536 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.746690 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.746845 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.746998 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.747253 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.747514 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.747683 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.748024 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.748188 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.748364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.748522 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.748676 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.748936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.749105 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.749359 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.749536 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.749693 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.749848 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.750012 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.750168 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.750323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.750489 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.750663 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.750827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.750982 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.751238 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.751398 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.751574 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.751731 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.751900 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.752056 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.752210 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.752210 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.752594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.752758 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.752925 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.753089 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.753243 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.753407 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.753570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.753735 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.753890 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.754045 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.754198 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.754373 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.754531 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.754686 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.754860 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.755015 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.755358 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.755541 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.755705 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.755871 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.756027 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.756181 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.756349 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.756512 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.756667 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.756822 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.756988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.756988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.757293 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.757465 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.757750 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.757919 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.758265 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.758438 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.758602 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.758774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.758949 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.759229 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.759781 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.759964 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.760129 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.760349 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.760994 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.761150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.761414 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.761576 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.761731 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.761885 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.762047 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.762203 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.762379 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.762537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.762699 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.762908 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.763109 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.763109 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.763428 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.763592 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.763749 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.763912 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.764067 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.764239 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.764432 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.764597 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.764753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.764753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.765056 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.765228 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.765541 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.765703 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.765858 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.766021 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.766176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.766347 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.766502 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.766668 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.767375 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.767543 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.767714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.767888 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.768051 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.768480 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.768655 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.768822 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.768987 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.769143 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.769389 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.769592 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.769820 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.769979 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.770144 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.770308 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.770465 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.770619 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.770781 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.770961 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.771154 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.771322 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.771570 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.771740 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.771908 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.772073 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.772229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.772392 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.772548 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.772548 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.772858 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.773024 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.773187 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.773342 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.773495 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.773658 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.773822 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.773997 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.774153 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.774316 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.774316 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.774613 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.774776 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.774945 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.774945 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.775262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.775416 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.775713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.775984 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.776186 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.776353 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.776638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.776815 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.776972 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.776972 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.777293 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.777293 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.777586 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.777586 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.777898 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.778009 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.778180 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.778286 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.778409 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.778672 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.778779 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.778960 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.779197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.779385 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.779623 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.779800 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.780040 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.780200 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.780355 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.780510 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.780684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.780848 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.781016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.781179 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.781335 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.781490 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.781740 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.781908 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.782074 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.782229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.782398 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.782562 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.782726 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.782892 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.783081 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.783254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.783420 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.783583 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.783738 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.783906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.784072 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.784228 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.784383 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.784547 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.784710 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.784880 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.785055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.785212 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.785375 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.785530 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.785828 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.786071 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.786071 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.786378 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.786541 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.786697 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.786854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.787023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.787214 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.787371 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.787536 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.787692 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.787856 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.788012 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.788167 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.788321 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.788475 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.788657 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.788986 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.789157 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.789314 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.789480 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.789480 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.789880 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.790075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.790307 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.790307 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.790615 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.790771 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.790926 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.791116 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.791278 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.791472 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.791472 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.792012 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.792189 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.792344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.792500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.792664 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.792664 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.792664 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.792664 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.792664 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.793384 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.793548 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.793703 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.793870 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.794039 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.794195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.794349 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.794513 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.794671 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.794841 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.795035 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.795235 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.795390 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.795556 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.795712 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.796024 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.796201 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.796365 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.796521 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.796678 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.796832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.796997 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.797161 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.797325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.797482 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.797637 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.797812 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.797978 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.798151 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.798307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.798462 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.798616 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.798791 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.799161 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.799325 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.799481 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.799636 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.799791 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.800044 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.800208 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.800446 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.800622 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.800787 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.800945 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.801110 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.801265 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.801419 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.801582 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.801747 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.801913 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.802155 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.802669 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.802845 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.802845 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.803215 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.803384 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.803555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.803719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.803882 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.804047 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.804203 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.804372 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.804535 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.804703 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.804861 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.805029 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.805200 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.805357 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.805514 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.805677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.805833 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.806152 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.806323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.806623 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.806792 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.806955 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.807659 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.807832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.808010 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.808167 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.808329 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.808486 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.808649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.808649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.808966 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.809313 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.809478 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.809641 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.809797 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.809797 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.810206 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.810378 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.810587 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.810753 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.810909 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.811099 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.811263 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.811431 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.811595 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.811751 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.811922 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.812086 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.812333 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.812506 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.812662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.812817 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.812988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.813153 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.813309 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.813464 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.813626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.813789 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.813955 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.814111 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.814266 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.814421 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.814597 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.814752 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.814920 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.815171 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.815334 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.815491 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.815645 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.815818 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.816116 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.816288 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.816444 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.816619 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.816854 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.817025 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.817181 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.817336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.817490 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.817644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.817807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.817972 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.818128 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.818292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.818448 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.818603 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.818758 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.819005 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.819214 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.819534 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.819705 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.819870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.820036 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.820223 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.820457 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.820625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.820789 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.820961 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.820961 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.821283 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.821458 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.821622 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.821622 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.821927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.822095 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.822260 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.822503 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.822664 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.822885 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.823554 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.823724 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.823881 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.824048 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.824210 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.824374 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.824547 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.824714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.824870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.825033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.825196 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.825196 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.825515 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.825515 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.825818 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.825818 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.826462 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.826634 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.826806 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.827124 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.827300 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.827300 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.827619 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.827785 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.827942 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.828105 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.828269 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.828441 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.828607 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.828772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.828937 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.829092 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.829249 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.829414 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.829752 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.829929 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.830169 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.830330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.830584 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.830754 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.831568 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.831732 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.831897 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.832068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.832233 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.832391 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.832646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.832808 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.832979 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.833136 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.833290 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.833466 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.833631 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.833795 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.833965 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.834129 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.834334 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.834507 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.834687 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.834851 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.835022 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.835202 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.835371 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.835527 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.835704 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.835869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.836040 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.836040 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.836353 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.836687 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 13:13:57.836852 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 13:13:57.836852 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 13:13:57.878984 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO dbcounter [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] Registered counter for database nova_api Sep 09 13:13:57.879291 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO dbcounter [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] Registered counter for database nova_api Sep 09 13:13:57.900170 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_db.sqlalchemy.engines [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:13:57.901877 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_db.sqlalchemy.engines [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:13:57.906831 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writer thread running {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:13:57.908595 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writer thread running {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:13:57.964406 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.context [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),097b70e7-360a-44be-bba2-9f31f45eed49(cell1) {{(pid=120623) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 13:13:57.966752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.context [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),097b70e7-360a-44be-bba2-9f31f45eed49(cell1) {{(pid=120625) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 13:13:57.968390 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:13:57.968869 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:13:57.970428 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:13:57.970800 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:13:57.971199 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:13:57.971327 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:13:57.971652 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:13:57.972891 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:13:57.973630 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:13:57.973737 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:13:57.974073 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:13:57.975657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO dbcounter [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] Registered counter for database nova_cell0 Sep 09 13:13:57.976068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:13:57.978068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO dbcounter [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] Registered counter for database nova_cell0 Sep 09 13:13:57.979693 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO dbcounter [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] Registered counter for database nova_cell1 Sep 09 13:13:57.982387 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO dbcounter [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] Registered counter for database nova_cell1 Sep 09 13:13:57.987515 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_db.sqlalchemy.engines [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:13:57.989655 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_db.sqlalchemy.engines [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:13:57.992239 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writer thread running {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:13:57.992713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_db.sqlalchemy.engines [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:13:57.993741 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_db.sqlalchemy.engines [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:13:57.996499 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writer thread running {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:13:58.140970 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writer thread running {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:13:58.149557 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO dbcounter [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] Registered counter for database nova_cell0 Sep 09 13:13:58.157105 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_db.sqlalchemy.engines [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:13:58.160954 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writer thread running {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:13:58.161625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writer thread running {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:13:58.170859 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO dbcounter [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] Registered counter for database nova_cell0 Sep 09 13:13:58.177802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_db.sqlalchemy.engines [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 13:13:58.183150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writer thread running {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 13:13:58.487012 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: WARNING keystonemiddleware.auth_token [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 13:13:58.494325 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: WARNING keystonemiddleware.auth_token [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 13:13:58.512739 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: WARNING keystonemiddleware.auth_token [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 13:13:58.520050 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: WARNING keystonemiddleware.auth_token [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 13:13:58.842932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: WARNING keystonemiddleware.auth_token [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 13:13:58.848966 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: WARNING keystonemiddleware.auth_token [None req-28a5ddd5-5fcd-4a22-a0dd-825a63db4a1a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 13:13:58.854981 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560e446299c0 pid: 120623 (default app) Sep 09 13:13:58.890736 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: WARNING keystonemiddleware.auth_token [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 13:13:58.897527 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: WARNING keystonemiddleware.auth_token [None req-94fd2b3d-8cff-4bfc-82ac-287ea26707eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 13:13:58.903703 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560e446299c0 pid: 120625 (default app) Sep 09 13:14:35.630922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:35.632827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:35.634194 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:35.635596 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:37.302909 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-828eed10-3f1b-4583-a7f9-c8b9b794bc4d tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Action: 'create', calling method: .version_select at 0x7fd4a285a430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1406660196"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:14:39.659907 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-828eed10-3f1b-4583-a7f9-c8b9b794bc4d tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.047396 Sep 09 13:14:39.671759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1155 bytes} [Fri Sep 9 13:14:35 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4062 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 13:14:39.682802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:39.685798 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:39.688076 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:39.692610 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:14:40.272666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1c115171-a566-4b3c-9145-c0b35575423f tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a2910940>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:40.828051 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1c115171-a566-4b3c-9145-c0b35575423f tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa" status: 200 len: 346 microversion: 2.1 time: 1.151785 Sep 09 13:14:40.830333 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 1/2] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:14:39 2022] GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa => generated 346 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:14:40.845786 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6469a6ae-6b7e-4252-9114-1135aa4884e3 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Action: 'create', calling method: .version_select at 0x7fd4a272c280>, body: {"snapshot": {"volume_id": "b5dd97c4-2903-4c67-b48a-ebbbd81addfa", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-354533756"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:14:41.400518 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6469a6ae-6b7e-4252-9114-1135aa4884e3 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.560345 Sep 09 13:14:41.402105 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1162 bytes} [Fri Sep 9 13:14:40 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:14:41.414331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fa51cf28-b6d4-4418-adcd-15323506a7ac tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a2724280>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:42.098084 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fa51cf28-b6d4-4418-adcd-15323506a7ac tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45" status: 200 len: 286 microversion: 2.1 time: 0.687729 Sep 09 13:14:42.099368 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 13:14:41 2022] GET /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45 => generated 286 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:14:42.111497 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6fdcb47e-3e87-4fed-bf89-dd3ad60beddd tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a26bf550>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:42.672512 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6fdcb47e-3e87-4fed-bf89-dd3ad60beddd tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.564944 Sep 09 13:14:42.673512 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 3/5] 10.222.0.17 () {58 vars in 1140 bytes} [Fri Sep 9 13:14:42 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:14:42.685962 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14de143f-54d6-49b8-a5af-7d25a67dd0a6 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a27249d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:42.947010 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14de143f-54d6-49b8-a5af-7d25a67dd0a6 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45" status: 200 len: 286 microversion: 2.1 time: 0.265195 Sep 09 13:14:42.948015 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 3/6] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 13:14:42 2022] GET /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45 => generated 286 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:14:43.962859 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f2e54346-d886-45e1-ba01-4f66cd798adc tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a26bfca0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:44.058271 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f2e54346-d886-45e1-ba01-4f66cd798adc tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45" status: 200 len: 286 microversion: 2.1 time: 0.100382 Sep 09 13:14:44.060327 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 13:14:43 2022] GET /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45 => generated 286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:14:45.077826 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4ce00c7b-058a-42fc-a509-36cf5ca8cbdd tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a2724b80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:45.127558 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4ce00c7b-058a-42fc-a509-36cf5ca8cbdd tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45" status: 200 len: 287 microversion: 2.1 time: 0.058214 Sep 09 13:14:45.136139 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 13:14:45 2022] GET /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:14:45.148869 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-00da8fb1-6717-4081-83b1-18438a6d9117 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a26bf310>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:45.306598 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-00da8fb1-6717-4081-83b1-18438a6d9117 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45" status: 202 len: 0 microversion: 2.1 time: 0.162304 Sep 09 13:14:45.307331 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 5/9] 10.222.0.17 () {58 vars in 1254 bytes} [Fri Sep 9 13:14:45 2022] DELETE /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:14:45.325402 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1da84c5f-de5d-49fd-afe2-7d65f0f44210 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a2724310>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:45.425092 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-86d1e5e1-9b10-43b7-8433-bee92f01c957 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Action: 'create', calling method: .version_select at 0x7fd4a272cf70>, body: {"keypair": {"name": "tempest-keypair-1757740664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBIKTvF/cBPAmBgK5flEZOEHN6JOshv0aBGRtuVqFEgdN3xa83i+MgCalFSdyHkkKoMBUsAn4hoFRK+Y9tD7tmTEQ5LF/UGCsdyUvjQp1OZ+C05tyuMPEsUQI+HMR35tQ=="}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:14:45.456236 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1da84c5f-de5d-49fd-afe2-7d65f0f44210 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45" status: 200 len: 286 microversion: 2.1 time: 0.142537 Sep 09 13:14:45.463008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 5/10] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 13:14:45 2022] GET /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:14:45.565201 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-86d1e5e1-9b10-43b7-8433-bee92f01c957 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Getting quotas for project 6f6fd89d622647f49bd35dcaf8ceca55. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:14:45.600122 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-86d1e5e1-9b10-43b7-8433-bee92f01c957 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Getting quotas for user c31bb28e38864eff99fdd6938b1b89a0 and project 6f6fd89d622647f49bd35dcaf8ceca55. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:14:45.768528 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-86d1e5e1-9b10-43b7-8433-bee92f01c957 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.450623 Sep 09 13:14:45.769334 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 6/11] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 13:14:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:14:46.470423 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-771b6f68-a411-48fc-8a78-2eb4e64a815d tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a2731160>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-771b6f68-a411-48fc-8a78-2eb4e64a815d tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] HTTP exception thrown: Snapshot 694d0d96-b103-4c01-a314-c3d5a2b44a45 could not be found. Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-771b6f68-a411-48fc-8a78-2eb4e64a815d tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Request method failure captured: Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45 HTTP/1.1 Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzw7HZakj0dRe0UYnk2Yc0qJtfWAHL0GvUuCzNi0FWwI__2w771PfyVZACQ87IgH-2icUNjIbRg-6oOm67_3OrOe9cVzRoCSPOHB3YSRvmBC7QTpa9_9qi0G1_f87QQD1n-6S5yzEyrjxAZ_rK_EchzwDHjYi3_rBo6OILwybb0JC_U Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 995f9843e1994072b79c1f0b38c96140 Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-971497944 Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:14:46.538931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:14:46.540323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/995f9843e1994072b79c1f0b38c96140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995f9843e1994072b79c1f0b38c96140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995f9843e1994072b79c1f0b38c96140"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_995f9843e1994072b79c1f0b38c96140", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:14:46.540323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesSnapshotsTestJSON-971497944 Sep 09 13:14:46.540323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 995f9843e1994072b79c1f0b38c96140 Sep 09 13:14:46.540323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-971497944 Sep 09 13:14:46.540323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesSnapshotsTestJSON-971497944-project Sep 09 13:14:46.540323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:14:46.540323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:14:46.540323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: 021f677dcf064541835e9a68efe5b145 Sep 09 13:14:46.540323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesSnapshotsTestJSON-971497944-project Sep 09 13:14:46.540323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: Sep 09 13:14:46.540323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Snapshot 694d0d96-b103-4c01-a314-c3d5a2b44a45 could not be found. Sep 09 13:14:46.540323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '694d0d96-b103-4c01-a314-c3d5a2b44a45'} Sep 09 13:14:46.540323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 694d0d96-b103-4c01-a314-c3d5a2b44a45 could not be found. (HTTP 404) (Request-ID: req-18a27fef-ab29-4570-b215-83315f3c6355) Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:14:46.540968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:14:46.541807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 694d0d96-b103-4c01-a314-c3d5a2b44a45 could not be found. Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 09 13:14:46.542719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:14:46.544033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 694d0d96-b103-4c01-a314-c3d5a2b44a45 could not be found. Sep 09 13:14:46.544033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:14:46.544033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:14:46.544033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:14:46.544033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:46.544033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:14:46.544033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:14:46.544033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:14:46.544033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:14:46.544033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 694d0d96-b103-4c01-a314-c3d5a2b44a45 could not be found. Sep 09 13:14:46.544033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:14:46.544033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-771b6f68-a411-48fc-8a78-2eb4e64a815d tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Returning 404 to user: Snapshot 694d0d96-b103-4c01-a314-c3d5a2b44a45 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:14:46.544033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-771b6f68-a411-48fc-8a78-2eb4e64a815d tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45" status: 404 len: 111 microversion: 2.1 time: 0.072433 Sep 09 13:14:46.544033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1251 bytes} [Fri Sep 9 13:14:46 2022] GET /compute/v2.1/os-snapshots/694d0d96-b103-4c01-a314-c3d5a2b44a45 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:14:46.552003 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e59ef036-fda4-4234-9fbc-32c343dddc91 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a26aa820>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:46.740307 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e59ef036-fda4-4234-9fbc-32c343dddc91 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa" status: 202 len: 0 microversion: 2.1 time: 0.192037 Sep 09 13:14:46.740936 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 13:14:46 2022] DELETE /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:14:46.752250 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fdfdc3bf-2937-4cf3-a160-f369594b167f tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a2731b80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:46.816833 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fdfdc3bf-2937-4cf3-a160-f369594b167f tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa" status: 200 len: 345 microversion: 2.1 time: 0.070699 Sep 09 13:14:46.817829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 7/14] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:14:46 2022] GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:14:47.579670 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-420136194", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "networks": [{"uuid": "0b98b4f6-87c3-4399-941e-84f1340022b2"}]}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:14:47.770165 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] validate_networks() for [('0b98b4f6-87c3-4399-941e-84f1340022b2', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:14:47.834119 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7c423b6c-ffcf-43b3-89bf-462f8edd91e9 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a2691280>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:47.944112 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7c423b6c-ffcf-43b3-89bf-462f8edd91e9 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa" status: 200 len: 345 microversion: 2.1 time: 0.115466 Sep 09 13:14:47.945244 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 8/15] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:14:47 2022] GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa => generated 345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:14:48.960374 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6a875e47-d98d-4900-a7e4-031ef65f8715 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a2731c10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:49.104509 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6a875e47-d98d-4900-a7e4-031ef65f8715 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa" status: 200 len: 345 microversion: 2.1 time: 0.148619 Sep 09 13:14:49.105322 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 9/16] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:14:48 2022] GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa => generated 345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:14:49.112991 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-583238474", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "235dfee9-07ca-4a76-8598-6158055e7838"}], "security_groups": [{"name": "tempest-securitygroup--1903402175"}], "key_name": "tempest-keypair-1757740664", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:14:49.407391 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] validate_networks() for [('235dfee9-07ca-4a76-8598-6158055e7838', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:14:50.074237 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:14:50.077211 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:14:50.078282 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:14:50.082340 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:14:50.083631 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:14:50.115700 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:50.116497 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:50.117084 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:50.118191 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:50.118797 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:50.119538 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:50.199453 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Getting quotas for project 80ecff6bf26f4cbeadb78b7272febb35. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:14:50.215088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Getting quotas for user efeb17c5a72b4e9294a63cf185737f3f and project 80ecff6bf26f4cbeadb78b7272febb35. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:14:50.255186 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:14:50.260311 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:14:50.468267 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0958bbda-ffc5-4a2b-ac80-addcfe01de07 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.979972 Sep 09 13:14:50.483459 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 8/17] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:14:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:14:50.514770 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e41526d6-36fe-41d1-8d7a-26bc57ded9dc tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a25f4af0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:50.626281 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e41526d6-36fe-41d1-8d7a-26bc57ded9dc tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa" status: 200 len: 345 microversion: 2.1 time: 0.141433 Sep 09 13:14:50.627395 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 9/18] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:14:50 2022] GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa => generated 345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:14:50.632376 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-78626085-fd94-46b0-bef3-27d11f199152 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:50.633161 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-78626085-fd94-46b0-bef3-27d11f199152 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:14:50.753829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:14:50.754878 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:14:50.755585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:14:50.756262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:14:50.758296 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:14:50.789953 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:50.791873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:50.792578 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:50.795799 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:50.796471 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:50.798389 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:50.853582 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Getting quotas for project 6f6fd89d622647f49bd35dcaf8ceca55. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:14:50.865630 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Getting quotas for user c31bb28e38864eff99fdd6938b1b89a0 and project 6f6fd89d622647f49bd35dcaf8ceca55. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:14:50.905937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:14:50.910792 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:14:50.929717 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-78626085-fd94-46b0-bef3-27d11f199152 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:14:50.968756 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-78626085-fd94-46b0-bef3-27d11f199152 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1214 microversion: 2.1 time: 0.340044 Sep 09 13:14:50.970116 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 10/19] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:14:50 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1214 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:14:51.111818 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f8099a02-fe21-49b4-97c4-1f3a5ad38d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.003527 Sep 09 13:14:51.115734 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 10/20] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:14:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:14:51.126738 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-27919de6-e9fb-4c61-956f-6c9154c083d4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:51.129074 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-27919de6-e9fb-4c61-956f-6c9154c083d4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:14:51.267965 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-27919de6-e9fb-4c61-956f-6c9154c083d4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:14:51.281385 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-27919de6-e9fb-4c61-956f-6c9154c083d4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1237 microversion: 2.1 time: 0.159490 Sep 09 13:14:51.286618 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 11/21] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:14:51 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1237 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:14:51.645005 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ec80553-7bc1-403c-8b8d-7a80b7c88982 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a25a2c10>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:51.813860 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ec80553-7bc1-403c-8b8d-7a80b7c88982 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa" status: 200 len: 345 microversion: 2.1 time: 0.175845 Sep 09 13:14:51.814440 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 11/22] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:14:51 2022] GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa => generated 345 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:14:52.010251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-af37510f-395e-4294-ae65-b93ce2b4156e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:52.014947 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-af37510f-395e-4294-ae65-b93ce2b4156e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:14:52.210679 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-af37510f-395e-4294-ae65-b93ce2b4156e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:14:52.223585 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-af37510f-395e-4294-ae65-b93ce2b4156e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1214 microversion: 2.1 time: 0.228062 Sep 09 13:14:52.233183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 12/23] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:14:51 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1214 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:14:52.316506 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-77860a70-a153-45f5-90b2-2edd4bb48e5d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:52.318264 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-77860a70-a153-45f5-90b2-2edd4bb48e5d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:14:52.481941 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-77860a70-a153-45f5-90b2-2edd4bb48e5d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:14:52.510277 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-77860a70-a153-45f5-90b2-2edd4bb48e5d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1237 microversion: 2.1 time: 0.200167 Sep 09 13:14:52.511663 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 12/24] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:14:52 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1237 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:14:52.829024 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-233c305b-7108-4c71-bc6f-16ad171f71d1 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a25ae5e0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:52.890486 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-233c305b-7108-4c71-bc6f-16ad171f71d1 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] HTTP exception thrown: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-233c305b-7108-4c71-bc6f-16ad171f71d1 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Request method failure captured: Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa HTTP/1.1 Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzw7HZakj0dRe0UYnk2Yc0qJtfWAHL0GvUuCzNi0FWwI__2w771PfyVZACQ87IgH-2icUNjIbRg-6oOm67_3OrOe9cVzRoCSPOHB3YSRvmBC7QTpa9_9qi0G1_f87QQD1n-6S5yzEyrjxAZ_rK_EchzwDHjYi3_rBo6OILwybb0JC_U Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 995f9843e1994072b79c1f0b38c96140 Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-971497944 Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:14:52.895714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:14:52.896833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/995f9843e1994072b79c1f0b38c96140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995f9843e1994072b79c1f0b38c96140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995f9843e1994072b79c1f0b38c96140"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_995f9843e1994072b79c1f0b38c96140", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:14:52.896833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-VolumesSnapshotsTestJSON-971497944 Sep 09 13:14:52.896833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 995f9843e1994072b79c1f0b38c96140 Sep 09 13:14:52.896833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-971497944 Sep 09 13:14:52.896833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-VolumesSnapshotsTestJSON-971497944-project Sep 09 13:14:52.896833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:14:52.896833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:14:52.896833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: 021f677dcf064541835e9a68efe5b145 Sep 09 13:14:52.896833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-VolumesSnapshotsTestJSON-971497944-project Sep 09 13:14:52.896833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: Sep 09 13:14:52.896833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:52.896833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'b5dd97c4-2903-4c67-b48a-ebbbd81addfa'} Sep 09 13:14:52.896833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. (HTTP 404) (Request-ID: req-44b309e7-f253-4e40-9476-1b9673ce9522) Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:14:52.897477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:14:52.898360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 13:14:52.899298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:14:52.900292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:52.900292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:14:52.900292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:14:52.900292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:14:52.900292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:52.900292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:14:52.900292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:14:52.900292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:14:52.900292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:14:52.900292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:52.900292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:14:52.900292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-233c305b-7108-4c71-bc6f-16ad171f71d1 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Returning 404 to user: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:14:52.900292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-233c305b-7108-4c71-bc6f-16ad171f71d1 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa" status: 404 len: 109 microversion: 2.1 time: 0.072603 Sep 09 13:14:52.902114 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 13/25] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:14:52 2022] GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:14:52.917266 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-810815ba-a17a-4c8e-8222-edb370d91fd4 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a25bbaf0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:53.117797 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-810815ba-a17a-4c8e-8222-edb370d91fd4 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] HTTP exception thrown: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-810815ba-a17a-4c8e-8222-edb370d91fd4 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Request method failure captured: Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa HTTP/1.1 Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzw7HZakj0dRe0UYnk2Yc0qJtfWAHL0GvUuCzNi0FWwI__2w771PfyVZACQ87IgH-2icUNjIbRg-6oOm67_3OrOe9cVzRoCSPOHB3YSRvmBC7QTpa9_9qi0G1_f87QQD1n-6S5yzEyrjxAZ_rK_EchzwDHjYi3_rBo6OILwybb0JC_U Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 995f9843e1994072b79c1f0b38c96140 Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-971497944 Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:14:53.122454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:14:53.123934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/995f9843e1994072b79c1f0b38c96140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995f9843e1994072b79c1f0b38c96140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995f9843e1994072b79c1f0b38c96140"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_995f9843e1994072b79c1f0b38c96140", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:14:53.123934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesSnapshotsTestJSON-971497944 Sep 09 13:14:53.123934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 995f9843e1994072b79c1f0b38c96140 Sep 09 13:14:53.123934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-971497944 Sep 09 13:14:53.123934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesSnapshotsTestJSON-971497944-project Sep 09 13:14:53.123934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:14:53.123934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:14:53.123934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: 021f677dcf064541835e9a68efe5b145 Sep 09 13:14:53.123934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesSnapshotsTestJSON-971497944-project Sep 09 13:14:53.123934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: Sep 09 13:14:53.123934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:53.123934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': 'b5dd97c4-2903-4c67-b48a-ebbbd81addfa'} Sep 09 13:14:53.123934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. (HTTP 404) (Request-ID: req-fa012452-504c-4a66-85d6-5fdedaf37f23) Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:14:53.124626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 13:14:53.125640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 13:14:53.126580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:14:53.129544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:53.129544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:14:53.129544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:14:53.129544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:14:53.129544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:53.129544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:14:53.129544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:14:53.129544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:14:53.129544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:14:53.129544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:53.129544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:14:53.129544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-810815ba-a17a-4c8e-8222-edb370d91fd4 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Returning 404 to user: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:14:53.129544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-810815ba-a17a-4c8e-8222-edb370d91fd4 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa" status: 404 len: 109 microversion: 2.1 time: 0.213509 Sep 09 13:14:53.129544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 13/26] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 13:14:52 2022] DELETE /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa => generated 109 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:14:53.138229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-00dd7cbb-9103-442a-b797-1a448befb112 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Calling method '.version_select at 0x7fd4a25ae700>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:53.385595 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-00dd7cbb-9103-442a-b797-1a448befb112 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] HTTP exception thrown: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-00dd7cbb-9103-442a-b797-1a448befb112 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Request method failure captured: Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa HTTP/1.1 Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzw7HZakj0dRe0UYnk2Yc0qJtfWAHL0GvUuCzNi0FWwI__2w771PfyVZACQ87IgH-2icUNjIbRg-6oOm67_3OrOe9cVzRoCSPOHB3YSRvmBC7QTpa9_9qi0G1_f87QQD1n-6S5yzEyrjxAZ_rK_EchzwDHjYi3_rBo6OILwybb0JC_U Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 995f9843e1994072b79c1f0b38c96140 Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-971497944 Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:14:53.389224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:14:53.390405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/995f9843e1994072b79c1f0b38c96140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995f9843e1994072b79c1f0b38c96140"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/995f9843e1994072b79c1f0b38c96140"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_995f9843e1994072b79c1f0b38c96140", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:14:53.390405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-VolumesSnapshotsTestJSON-971497944 Sep 09 13:14:53.390405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 995f9843e1994072b79c1f0b38c96140 Sep 09 13:14:53.390405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-971497944 Sep 09 13:14:53.390405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-VolumesSnapshotsTestJSON-971497944-project Sep 09 13:14:53.390405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:14:53.390405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:14:53.390405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: 021f677dcf064541835e9a68efe5b145 Sep 09 13:14:53.390405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-VolumesSnapshotsTestJSON-971497944-project Sep 09 13:14:53.390405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: Sep 09 13:14:53.390405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:53.390405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'b5dd97c4-2903-4c67-b48a-ebbbd81addfa'} Sep 09 13:14:53.390405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. (HTTP 404) (Request-ID: req-8a60353d-95de-43f7-b09b-14502e5bf1bc) Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:14:53.391088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:14:53.392985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 13:14:53.393867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:14:53.395906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:53.395906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:14:53.395906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:14:53.395906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:14:53.395906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:14:53.395906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:14:53.395906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:14:53.395906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:14:53.395906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:14:53.395906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. Sep 09 13:14:53.395906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:14:53.395906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-00dd7cbb-9103-442a-b797-1a448befb112 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] Returning 404 to user: Volume b5dd97c4-2903-4c67-b48a-ebbbd81addfa could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:14:53.395906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-00dd7cbb-9103-442a-b797-1a448befb112 tempest-VolumesSnapshotsTestJSON-971497944 tempest-VolumesSnapshotsTestJSON-971497944-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa" status: 404 len: 109 microversion: 2.1 time: 0.259867 Sep 09 13:14:53.395906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 14/27] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:14:53 2022] GET /compute/v2.1/os-volumes/b5dd97c4-2903-4c67-b48a-ebbbd81addfa => generated 109 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:14:53.418246 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-11eb955f-2781-49eb-871f-be2fd8a3c927 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:53.420445 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-11eb955f-2781-49eb-871f-be2fd8a3c927 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:14:53.445221 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11eb955f-2781-49eb-871f-be2fd8a3c927 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:53.449365 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11eb955f-2781-49eb-871f-be2fd8a3c927 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:53.452823 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11eb955f-2781-49eb-871f-be2fd8a3c927 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:53.455826 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11eb955f-2781-49eb-871f-be2fd8a3c927 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:53.457327 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11eb955f-2781-49eb-871f-be2fd8a3c927 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:53.460031 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11eb955f-2781-49eb-871f-be2fd8a3c927 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:53.469051 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1391331123", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:14:53.599141 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] validate_networks() for [('35f83991-e6e5-4bd4-8a1f-6fb94f31874e', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:14:53.964263 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-11eb955f-2781-49eb-871f-be2fd8a3c927 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:14:53.995709 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-11eb955f-2781-49eb-871f-be2fd8a3c927 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1210 microversion: 2.1 time: 0.601746 Sep 09 13:14:54.009989 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 15/28] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:14:53 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1210 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:14:54.026723 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-55e60a86-5c7b-44d0-9f75-71b169c3c3d5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:54.030748 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-55e60a86-5c7b-44d0-9f75-71b169c3c3d5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:14:54.051260 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55e60a86-5c7b-44d0-9f75-71b169c3c3d5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:54.056070 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55e60a86-5c7b-44d0-9f75-71b169c3c3d5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:54.056773 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55e60a86-5c7b-44d0-9f75-71b169c3c3d5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:54.060149 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55e60a86-5c7b-44d0-9f75-71b169c3c3d5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:54.060753 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55e60a86-5c7b-44d0-9f75-71b169c3c3d5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:54.061567 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55e60a86-5c7b-44d0-9f75-71b169c3c3d5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:54.224889 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-55e60a86-5c7b-44d0-9f75-71b169c3c3d5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:14:54.238872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-55e60a86-5c7b-44d0-9f75-71b169c3c3d5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1233 microversion: 2.1 time: 0.227763 Sep 09 13:14:54.246629 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 16/29] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:14:54 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1233 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:14:54.747582 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-047f6619-aa70-470b-bbcd-af64a2d72266 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Action: 'create', calling method: .version_select at 0x7fd4a25ae4c0>, body: {"keypair": {"name": "tempest-keypair-1406340475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcAdCcCO0WtPiXvQ8Qzu5p+ZKtMt7hpKt39yhXkUdQ3DqUAGDCBd55YSpwi4CP/TbFP+kvNTAFle0HpcsHTYlOjEiE496N6/1d2xWa0ysyIACFl+bEO0y62XK2pDCRh+A=="}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:14:54.749594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:14:54.750067 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:14:54.750551 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:14:54.751034 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:14:54.751520 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:14:54.772812 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:54.780386 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:54.780914 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:54.789643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:54.790274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:54.790727 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:54.808554 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-047f6619-aa70-470b-bbcd-af64a2d72266 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:14:54.832160 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-047f6619-aa70-470b-bbcd-af64a2d72266 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for user dcb88983a8e1439588644b71170d7362 and project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:14:54.859514 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Getting quotas for project 1eedefa6b656409f902d158e77d94aa0. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:14:54.888088 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Getting quotas for user 21700a3c2ff24fc6a3bb5db8bf283f5c and project 1eedefa6b656409f902d158e77d94aa0. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:14:54.947823 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:14:54.953277 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:14:54.956461 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-047f6619-aa70-470b-bbcd-af64a2d72266 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.699707 Sep 09 13:14:54.957248 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 17/30] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 13:14:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:14:55.033876 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-91d8b384-d849-4ebf-94a8-7e93cc1f5c0c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:55.035800 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-91d8b384-d849-4ebf-94a8-7e93cc1f5c0c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:14:55.070176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-91d8b384-d849-4ebf-94a8-7e93cc1f5c0c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:55.070438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-91d8b384-d849-4ebf-94a8-7e93cc1f5c0c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:55.070880 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-91d8b384-d849-4ebf-94a8-7e93cc1f5c0c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:55.071620 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-91d8b384-d849-4ebf-94a8-7e93cc1f5c0c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:55.077977 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-91d8b384-d849-4ebf-94a8-7e93cc1f5c0c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:55.086202 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-91d8b384-d849-4ebf-94a8-7e93cc1f5c0c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:55.195860 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d171fe11-5559-450f-8e48-1fb5370660fd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.003227 Sep 09 13:14:55.210042 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 14/31] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:14:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:14:55.230953 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2aea8765-8898-4cc0-92d4-394cec9f9b77 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:55.238340 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2aea8765-8898-4cc0-92d4-394cec9f9b77 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:14:55.794245 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2aea8765-8898-4cc0-92d4-394cec9f9b77 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:14:55.804401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2aea8765-8898-4cc0-92d4-394cec9f9b77 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1222 microversion: 2.1 time: 0.592684 Sep 09 13:14:55.805453 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 15/32] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:14:55 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1222 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:14:55.847327 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-589d5aee-48f4-418d-81a9-1d51dc58a544 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:55.852046 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-589d5aee-48f4-418d-81a9-1d51dc58a544 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:14:55.884616 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589d5aee-48f4-418d-81a9-1d51dc58a544 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:55.885181 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589d5aee-48f4-418d-81a9-1d51dc58a544 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:55.885628 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589d5aee-48f4-418d-81a9-1d51dc58a544 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:55.892868 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589d5aee-48f4-418d-81a9-1d51dc58a544 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:55.893676 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589d5aee-48f4-418d-81a9-1d51dc58a544 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:55.894607 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589d5aee-48f4-418d-81a9-1d51dc58a544 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:55.991979 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-91d8b384-d849-4ebf-94a8-7e93cc1f5c0c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:14:56.000705 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-91d8b384-d849-4ebf-94a8-7e93cc1f5c0c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1272 microversion: 2.1 time: 0.972207 Sep 09 13:14:56.006263 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 18/33] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:14:55 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1272 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:14:56.220119 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-99152519", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:14:56.352068 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] validate_networks() for [('35f83991-e6e5-4bd4-8a1f-6fb94f31874e', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:14:56.530523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-589d5aee-48f4-418d-81a9-1d51dc58a544 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:14:56.558821 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-589d5aee-48f4-418d-81a9-1d51dc58a544 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1295 microversion: 2.1 time: 0.721959 Sep 09 13:14:56.562009 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 16/34] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:14:55 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1295 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:14:57.035610 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5b2d05af-2a3d-4550-bc9b-48fb1790b5d5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:57.037855 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b2d05af-2a3d-4550-bc9b-48fb1790b5d5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:14:57.056426 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b2d05af-2a3d-4550-bc9b-48fb1790b5d5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:57.063445 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b2d05af-2a3d-4550-bc9b-48fb1790b5d5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:57.064996 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b2d05af-2a3d-4550-bc9b-48fb1790b5d5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:57.067313 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b2d05af-2a3d-4550-bc9b-48fb1790b5d5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:57.075807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b2d05af-2a3d-4550-bc9b-48fb1790b5d5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:57.076904 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b2d05af-2a3d-4550-bc9b-48fb1790b5d5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:57.369027 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5b2d05af-2a3d-4550-bc9b-48fb1790b5d5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:14:57.400436 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5b2d05af-2a3d-4550-bc9b-48fb1790b5d5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1272 microversion: 2.1 time: 0.367805 Sep 09 13:14:57.406018 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 17/35] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:14:57 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1272 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:14:57.586094 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba54a23a-e28e-49ec-99e1-5c2e2aa29880 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:57.587165 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba54a23a-e28e-49ec-99e1-5c2e2aa29880 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:14:57.605128 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba54a23a-e28e-49ec-99e1-5c2e2aa29880 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:57.607936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba54a23a-e28e-49ec-99e1-5c2e2aa29880 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:57.610858 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba54a23a-e28e-49ec-99e1-5c2e2aa29880 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:57.614469 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba54a23a-e28e-49ec-99e1-5c2e2aa29880 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:57.617017 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba54a23a-e28e-49ec-99e1-5c2e2aa29880 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:57.618918 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba54a23a-e28e-49ec-99e1-5c2e2aa29880 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:58.174987 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba54a23a-e28e-49ec-99e1-5c2e2aa29880 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:14:58.210165 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba54a23a-e28e-49ec-99e1-5c2e2aa29880 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1295 microversion: 2.1 time: 0.624481 Sep 09 13:14:58.216306 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 18/36] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:14:57 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1295 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:14:58.449550 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b43f76fa-1ae1-4899-941d-ae7c28ffe674 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:58.450946 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b43f76fa-1ae1-4899-941d-ae7c28ffe674 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:14:58.462410 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b43f76fa-1ae1-4899-941d-ae7c28ffe674 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:58.464352 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b43f76fa-1ae1-4899-941d-ae7c28ffe674 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:58.466501 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b43f76fa-1ae1-4899-941d-ae7c28ffe674 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:58.468768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b43f76fa-1ae1-4899-941d-ae7c28ffe674 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:58.472680 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b43f76fa-1ae1-4899-941d-ae7c28ffe674 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:58.474780 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b43f76fa-1ae1-4899-941d-ae7c28ffe674 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:58.952072 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b43f76fa-1ae1-4899-941d-ae7c28ffe674 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:14:58.965590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b43f76fa-1ae1-4899-941d-ae7c28ffe674 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1272 microversion: 2.1 time: 0.540070 Sep 09 13:14:58.966600 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 19/37] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:14:58 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1272 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:14:59.242670 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-03ec3d37-9f6c-4b16-bc61-1f7ef5c3cf66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:59.244247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-03ec3d37-9f6c-4b16-bc61-1f7ef5c3cf66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:14:59.259584 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03ec3d37-9f6c-4b16-bc61-1f7ef5c3cf66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:59.270723 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03ec3d37-9f6c-4b16-bc61-1f7ef5c3cf66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:59.271738 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03ec3d37-9f6c-4b16-bc61-1f7ef5c3cf66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:59.272586 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03ec3d37-9f6c-4b16-bc61-1f7ef5c3cf66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:14:59.273140 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03ec3d37-9f6c-4b16-bc61-1f7ef5c3cf66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:14:59.273785 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03ec3d37-9f6c-4b16-bc61-1f7ef5c3cf66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:14:59.784600 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-03ec3d37-9f6c-4b16-bc61-1f7ef5c3cf66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:14:59.829901 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-03ec3d37-9f6c-4b16-bc61-1f7ef5c3cf66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1295 microversion: 2.1 time: 0.573148 Sep 09 13:14:59.837858 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 20/38] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:14:59 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1295 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:14:59.996425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2f6f938e-5587-4d45-b5a3-c60619c1d915 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:14:59.997891 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2f6f938e-5587-4d45-b5a3-c60619c1d915 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:00.021322 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f6f938e-5587-4d45-b5a3-c60619c1d915 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:00.021962 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f6f938e-5587-4d45-b5a3-c60619c1d915 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:00.029742 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f6f938e-5587-4d45-b5a3-c60619c1d915 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:00.030720 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f6f938e-5587-4d45-b5a3-c60619c1d915 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:00.031374 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f6f938e-5587-4d45-b5a3-c60619c1d915 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:00.036792 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2f6f938e-5587-4d45-b5a3-c60619c1d915 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:00.159141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:00.360809 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:15:00.361942 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:15:00.362617 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:15:00.363228 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:15:00.363889 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:15:00.388849 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:00.392052 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:00.392812 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:00.395941 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:00.398065 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:00.398859 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:00.471950 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Getting quotas for project 1eedefa6b656409f902d158e77d94aa0. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:15:00.486491 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Getting quotas for user 21700a3c2ff24fc6a3bb5db8bf283f5c and project 1eedefa6b656409f902d158e77d94aa0. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:15:00.521140 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:15:00.535237 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:15:00.772313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5bd28cb3-0937-482e-a8d3-f5d8978546b4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.552877 Sep 09 13:15:00.780644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:14:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 4566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 13:15:00.787679 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-41edc92e-0137-4562-a378-87eef13ffd35 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:00.788305 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-41edc92e-0137-4562-a378-87eef13ffd35 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:01.014266 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-41edc92e-0137-4562-a378-87eef13ffd35 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:01.057851 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-41edc92e-0137-4562-a378-87eef13ffd35 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1220 microversion: 2.1 time: 0.272070 Sep 09 13:15:01.075826 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 20/40] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:00 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1220 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:01.089522 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-156caaf9-04dd-498b-b2c8-ac323a7dd0b6 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:01.090242 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-156caaf9-04dd-498b-b2c8-ac323a7dd0b6 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:01.104697 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2f6f938e-5587-4d45-b5a3-c60619c1d915 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:01.109811 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-156caaf9-04dd-498b-b2c8-ac323a7dd0b6 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:01.112336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-156caaf9-04dd-498b-b2c8-ac323a7dd0b6 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:01.112832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-156caaf9-04dd-498b-b2c8-ac323a7dd0b6 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:01.117326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-156caaf9-04dd-498b-b2c8-ac323a7dd0b6 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:01.118099 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-156caaf9-04dd-498b-b2c8-ac323a7dd0b6 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:01.118604 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-156caaf9-04dd-498b-b2c8-ac323a7dd0b6 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:01.123974 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2f6f938e-5587-4d45-b5a3-c60619c1d915 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 1.131612 Sep 09 13:15:01.127756 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 21/41] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:14:59 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:01.475395 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-156caaf9-04dd-498b-b2c8-ac323a7dd0b6 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:01.486856 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-156caaf9-04dd-498b-b2c8-ac323a7dd0b6 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.409234 Sep 09 13:15:01.487762 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 21/42] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:01 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:02.089968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d7b68aa5-8ecf-4f7b-8d8f-c327180952da tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:02.091424 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d7b68aa5-8ecf-4f7b-8d8f-c327180952da tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:02.153882 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d870528f-5c33-41dc-8e4c-887d90733291 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:02.154508 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d870528f-5c33-41dc-8e4c-887d90733291 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:02.171669 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d870528f-5c33-41dc-8e4c-887d90733291 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:02.172588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d870528f-5c33-41dc-8e4c-887d90733291 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:02.173200 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d870528f-5c33-41dc-8e4c-887d90733291 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:02.174165 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d870528f-5c33-41dc-8e4c-887d90733291 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:02.174772 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d870528f-5c33-41dc-8e4c-887d90733291 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:02.175618 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d870528f-5c33-41dc-8e4c-887d90733291 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:03.031028 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d7b68aa5-8ecf-4f7b-8d8f-c327180952da tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:03.042590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d7b68aa5-8ecf-4f7b-8d8f-c327180952da tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1220 microversion: 2.1 time: 0.954665 Sep 09 13:15:03.054613 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 22/43] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:02 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1220 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:03.079651 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db560b26-7f36-47de-8a31-93f48fee649c tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:03.080290 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db560b26-7f36-47de-8a31-93f48fee649c tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:03.114374 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db560b26-7f36-47de-8a31-93f48fee649c tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:03.114374 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db560b26-7f36-47de-8a31-93f48fee649c tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:03.114374 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db560b26-7f36-47de-8a31-93f48fee649c tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:03.115267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db560b26-7f36-47de-8a31-93f48fee649c tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:03.115723 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db560b26-7f36-47de-8a31-93f48fee649c tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:03.116149 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db560b26-7f36-47de-8a31-93f48fee649c tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:03.401571 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d870528f-5c33-41dc-8e4c-887d90733291 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:03.410017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d870528f-5c33-41dc-8e4c-887d90733291 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 1.260252 Sep 09 13:15:03.417950 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 22/44] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:02 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:04.078854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-78cc8e67-0185-423c-9978-ea170240a78e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:04.079503 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-78cc8e67-0185-423c-9978-ea170240a78e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:04.104761 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-78cc8e67-0185-423c-9978-ea170240a78e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:04.112653 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-78cc8e67-0185-423c-9978-ea170240a78e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:04.113137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-78cc8e67-0185-423c-9978-ea170240a78e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:04.113902 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-78cc8e67-0185-423c-9978-ea170240a78e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:04.121897 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-78cc8e67-0185-423c-9978-ea170240a78e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:04.123600 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-78cc8e67-0185-423c-9978-ea170240a78e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:04.419293 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-db560b26-7f36-47de-8a31-93f48fee649c tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:04.444938 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db560b26-7f36-47de-8a31-93f48fee649c tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 1.379969 Sep 09 13:15:04.444938 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 23/45] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:03 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:04.464644 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-016c16d7-5c89-42d3-8242-1b6672895284 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:04.465526 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-016c16d7-5c89-42d3-8242-1b6672895284 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:04.498678 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-016c16d7-5c89-42d3-8242-1b6672895284 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:04.500520 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-016c16d7-5c89-42d3-8242-1b6672895284 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:04.501042 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-016c16d7-5c89-42d3-8242-1b6672895284 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:04.503676 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-016c16d7-5c89-42d3-8242-1b6672895284 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:04.504167 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-016c16d7-5c89-42d3-8242-1b6672895284 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:04.506922 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-016c16d7-5c89-42d3-8242-1b6672895284 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:04.700818 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-78cc8e67-0185-423c-9978-ea170240a78e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:04.713539 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-78cc8e67-0185-423c-9978-ea170240a78e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1290 microversion: 2.1 time: 0.639887 Sep 09 13:15:04.724352 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 23/46] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:04 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1290 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:04.831660 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:05.463778 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-360fd07c-a0a3-4d60-8503-73c8e2f550ab tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:05.464790 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-360fd07c-a0a3-4d60-8503-73c8e2f550ab tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:05.488742 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-360fd07c-a0a3-4d60-8503-73c8e2f550ab tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:05.489893 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-360fd07c-a0a3-4d60-8503-73c8e2f550ab tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:05.490947 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-360fd07c-a0a3-4d60-8503-73c8e2f550ab tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:05.493419 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-360fd07c-a0a3-4d60-8503-73c8e2f550ab tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:05.494896 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-360fd07c-a0a3-4d60-8503-73c8e2f550ab tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:05.496220 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-360fd07c-a0a3-4d60-8503-73c8e2f550ab tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:06.484454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-016c16d7-5c89-42d3-8242-1b6672895284 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:06.511792 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-016c16d7-5c89-42d3-8242-1b6672895284 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 2.059371 Sep 09 13:15:06.514940 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 24/47] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:04 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:06.538460 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2160b7ec-5cf6-427c-9966-111ec056d5dc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:06.539289 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2160b7ec-5cf6-427c-9966-111ec056d5dc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:06.562750 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2160b7ec-5cf6-427c-9966-111ec056d5dc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:06.565663 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2160b7ec-5cf6-427c-9966-111ec056d5dc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:06.566172 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2160b7ec-5cf6-427c-9966-111ec056d5dc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:06.572124 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2160b7ec-5cf6-427c-9966-111ec056d5dc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:06.572770 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2160b7ec-5cf6-427c-9966-111ec056d5dc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:06.573476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2160b7ec-5cf6-427c-9966-111ec056d5dc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:07.165792 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2160b7ec-5cf6-427c-9966-111ec056d5dc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:07.180051 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2160b7ec-5cf6-427c-9966-111ec056d5dc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1278 microversion: 2.1 time: 0.660107 Sep 09 13:15:07.182747 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 25/48] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:06 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1278 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:07.533519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-d626ba40-6ef9-4ff2-a6bb-826e706c1224 req-0ed4dde3-cefd-465a-9a83-57237c50bad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99000808-b419-4f81-b651-d9461adca1d7", "tag": "62440413-4def-40fe-bb82-2e853fce3d70"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:07.555376 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d626ba40-6ef9-4ff2-a6bb-826e706c1224 req-0ed4dde3-cefd-465a-9a83-57237c50bad4 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:07.571868 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d626ba40-6ef9-4ff2-a6bb-826e706c1224 req-0ed4dde3-cefd-465a-9a83-57237c50bad4 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:07.577086 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d626ba40-6ef9-4ff2-a6bb-826e706c1224 req-0ed4dde3-cefd-465a-9a83-57237c50bad4 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:07.640156 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-d626ba40-6ef9-4ff2-a6bb-826e706c1224 req-0ed4dde3-cefd-465a-9a83-57237c50bad4 service nova] Creating event network-changed:62440413-4def-40fe-bb82-2e853fce3d70 for instance 99000808-b419-4f81-b651-d9461adca1d7 on hv-cinder-83124 Sep 09 13:15:07.643277 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d626ba40-6ef9-4ff2-a6bb-826e706c1224 req-0ed4dde3-cefd-465a-9a83-57237c50bad4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 13:15:07.656907 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-d626ba40-6ef9-4ff2-a6bb-826e706c1224 req-0ed4dde3-cefd-465a-9a83-57237c50bad4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 13:15:07.658548 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d75174b-29ea-4f08-a1cb-0f2ef20e8d0e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:07.671707 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d75174b-29ea-4f08-a1cb-0f2ef20e8d0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:07.672557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d75174b-29ea-4f08-a1cb-0f2ef20e8d0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:07.673759 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d75174b-29ea-4f08-a1cb-0f2ef20e8d0e None None] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:07.674425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d75174b-29ea-4f08-a1cb-0f2ef20e8d0e None None] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:07.675105 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d75174b-29ea-4f08-a1cb-0f2ef20e8d0e None None] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:07.714700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.compute.rpcapi [None req-6d75174b-29ea-4f08-a1cb-0f2ef20e8d0e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 13:15:07.728297 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6d75174b-29ea-4f08-a1cb-0f2ef20e8d0e None None] Releasing lock "compute-rpcapi-router" {{(pid=120625) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 13:15:07.785413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6d75174b-29ea-4f08-a1cb-0f2ef20e8d0e None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.593004 Sep 09 13:15:07.787009 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 26/49] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:15:07.796940 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b6d00b97-f9fa-4974-8fc5-310119caac05 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:07.798600 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b6d00b97-f9fa-4974-8fc5-310119caac05 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:07.817274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d00b97-f9fa-4974-8fc5-310119caac05 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:07.819332 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d00b97-f9fa-4974-8fc5-310119caac05 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:07.826788 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d00b97-f9fa-4974-8fc5-310119caac05 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:07.828983 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d00b97-f9fa-4974-8fc5-310119caac05 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:07.829705 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d00b97-f9fa-4974-8fc5-310119caac05 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:07.833984 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b6d00b97-f9fa-4974-8fc5-310119caac05 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:07.998691 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-360fd07c-a0a3-4d60-8503-73c8e2f550ab tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:08.016836 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-360fd07c-a0a3-4d60-8503-73c8e2f550ab tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 2.558290 Sep 09 13:15:08.023768 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 24/50] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:05 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 2566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:08.223132 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-785f7873-2146-493c-b4b5-385d95830082 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:08.225512 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-785f7873-2146-493c-b4b5-385d95830082 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:08.254700 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:08.262092 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-785f7873-2146-493c-b4b5-385d95830082 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:08.275621 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-785f7873-2146-493c-b4b5-385d95830082 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:08.278478 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-785f7873-2146-493c-b4b5-385d95830082 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:08.284429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-785f7873-2146-493c-b4b5-385d95830082 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:08.290064 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-785f7873-2146-493c-b4b5-385d95830082 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:08.296875 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-785f7873-2146-493c-b4b5-385d95830082 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:08.738641 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-785f7873-2146-493c-b4b5-385d95830082 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:08.746482 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-785f7873-2146-493c-b4b5-385d95830082 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1278 microversion: 2.1 time: 0.538690 Sep 09 13:15:08.751349 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 25/51] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:08 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1278 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:08.784982 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b6d00b97-f9fa-4974-8fc5-310119caac05 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:08.796572 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b6d00b97-f9fa-4974-8fc5-310119caac05 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 1.007647 Sep 09 13:15:08.803170 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 27/52] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:07 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:09.050128 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6a529d4d-372e-4505-897f-75417175a22b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:09.051407 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6a529d4d-372e-4505-897f-75417175a22b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:09.068290 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a529d4d-372e-4505-897f-75417175a22b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:09.069333 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a529d4d-372e-4505-897f-75417175a22b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:09.076381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a529d4d-372e-4505-897f-75417175a22b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:09.077702 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a529d4d-372e-4505-897f-75417175a22b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:09.078418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a529d4d-372e-4505-897f-75417175a22b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:09.079152 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a529d4d-372e-4505-897f-75417175a22b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:09.257373 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-50d7cd2f-9958-4cbe-bcb8-c4a28e333e1f req-05cbf75f-745b-4772-b4ea-910ad6d2c05a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f12266-677e-473d-8fbd-bf3136398e58", "tag": "d0f7b8a7-7f54-44ba-988c-5391e6311e17"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:09.284048 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-50d7cd2f-9958-4cbe-bcb8-c4a28e333e1f req-05cbf75f-745b-4772-b4ea-910ad6d2c05a service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:09.284776 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-50d7cd2f-9958-4cbe-bcb8-c4a28e333e1f req-05cbf75f-745b-4772-b4ea-910ad6d2c05a service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:09.286461 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-50d7cd2f-9958-4cbe-bcb8-c4a28e333e1f req-05cbf75f-745b-4772-b4ea-910ad6d2c05a service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:09.351713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-50d7cd2f-9958-4cbe-bcb8-c4a28e333e1f req-05cbf75f-745b-4772-b4ea-910ad6d2c05a service nova] Creating event network-changed:d0f7b8a7-7f54-44ba-988c-5391e6311e17 for instance d7f12266-677e-473d-8fbd-bf3136398e58 on hv-cinder-83124 Sep 09 13:15:09.352250 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-50d7cd2f-9958-4cbe-bcb8-c4a28e333e1f req-05cbf75f-745b-4772-b4ea-910ad6d2c05a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120623) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 13:15:09.355954 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-50d7cd2f-9958-4cbe-bcb8-c4a28e333e1f req-05cbf75f-745b-4772-b4ea-910ad6d2c05a service nova] Acquired lock "compute-rpcapi-router" {{(pid=120623) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 13:15:09.359827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a5f9271-c118-48f0-bf8d-ebd8f4addb45 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:09.363406 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a5f9271-c118-48f0-bf8d-ebd8f4addb45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:09.364576 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a5f9271-c118-48f0-bf8d-ebd8f4addb45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:09.370027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a5f9271-c118-48f0-bf8d-ebd8f4addb45 None None] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:09.371282 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a5f9271-c118-48f0-bf8d-ebd8f4addb45 None None] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:09.373798 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a5f9271-c118-48f0-bf8d-ebd8f4addb45 None None] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:09.446435 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.compute.rpcapi [None req-5a5f9271-c118-48f0-bf8d-ebd8f4addb45 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 13:15:09.461045 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a5f9271-c118-48f0-bf8d-ebd8f4addb45 None None] Releasing lock "compute-rpcapi-router" {{(pid=120623) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 13:15:09.519658 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5a5f9271-c118-48f0-bf8d-ebd8f4addb45 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.704517 Sep 09 13:15:09.522149 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 26/53] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:15:09.540651 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-33047087", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2956cf21-dbaf-41ce-8ac8-8e3d7c788d07"}], "security_groups": [{"name": "tempest-securitygroup--927134930"}], "key_name": "tempest-keypair-1406340475", "user_data": "}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:10.276009 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] validate_networks() for [('2956cf21-dbaf-41ce-8ac8-8e3d7c788d07', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:15:10.418946 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6a529d4d-372e-4505-897f-75417175a22b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:10.463270 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6a529d4d-372e-4505-897f-75417175a22b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 1.382950 Sep 09 13:15:10.463270 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 28/54] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:09 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:10.463270 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fa1d0f27-e6ef-46d1-89ff-44bd49a8e839 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:10.463270 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fa1d0f27-e6ef-46d1-89ff-44bd49a8e839 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:10.479177 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:10.501050 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa1d0f27-e6ef-46d1-89ff-44bd49a8e839 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:10.501583 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa1d0f27-e6ef-46d1-89ff-44bd49a8e839 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:10.502027 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa1d0f27-e6ef-46d1-89ff-44bd49a8e839 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:10.502751 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa1d0f27-e6ef-46d1-89ff-44bd49a8e839 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:10.510188 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa1d0f27-e6ef-46d1-89ff-44bd49a8e839 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:10.510730 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa1d0f27-e6ef-46d1-89ff-44bd49a8e839 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:11.029505 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fa1d0f27-e6ef-46d1-89ff-44bd49a8e839 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:11.043025 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=28 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:11.045902 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fa1d0f27-e6ef-46d1-89ff-44bd49a8e839 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.598043 Sep 09 13:15:11.049447 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 29/55] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:10 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:11.063874 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b95291e5-d161-49ab-ab44-59eb7f03b5b5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:11.065259 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b95291e5-d161-49ab-ab44-59eb7f03b5b5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:11.087577 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b95291e5-d161-49ab-ab44-59eb7f03b5b5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:11.088865 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b95291e5-d161-49ab-ab44-59eb7f03b5b5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:11.091200 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b95291e5-d161-49ab-ab44-59eb7f03b5b5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:11.092818 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b95291e5-d161-49ab-ab44-59eb7f03b5b5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:11.094039 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b95291e5-d161-49ab-ab44-59eb7f03b5b5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:11.095942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b95291e5-d161-49ab-ab44-59eb7f03b5b5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:11.652542 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b95291e5-d161-49ab-ab44-59eb7f03b5b5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:11.664753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b95291e5-d161-49ab-ab44-59eb7f03b5b5 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.612667 Sep 09 13:15:11.669311 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 30/56] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:11 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:11.680537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d626ff1d-4dad-43cf-aa88-51b397b5e52f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:11.684477 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d626ff1d-4dad-43cf-aa88-51b397b5e52f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:11.697649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d626ff1d-4dad-43cf-aa88-51b397b5e52f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:11.701627 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d626ff1d-4dad-43cf-aa88-51b397b5e52f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:11.702361 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d626ff1d-4dad-43cf-aa88-51b397b5e52f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:11.705054 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d626ff1d-4dad-43cf-aa88-51b397b5e52f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:11.705686 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d626ff1d-4dad-43cf-aa88-51b397b5e52f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:11.707113 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d626ff1d-4dad-43cf-aa88-51b397b5e52f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:12.065087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d626ff1d-4dad-43cf-aa88-51b397b5e52f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:12.080485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d626ff1d-4dad-43cf-aa88-51b397b5e52f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.409827 Sep 09 13:15:12.081430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 31/57] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:11 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:12.094476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cd4a550c-79f8-4023-b517-434f05616ec8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:12.095286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cd4a550c-79f8-4023-b517-434f05616ec8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:12.106650 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd4a550c-79f8-4023-b517-434f05616ec8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:12.111488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd4a550c-79f8-4023-b517-434f05616ec8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:12.112336 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd4a550c-79f8-4023-b517-434f05616ec8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:12.113524 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd4a550c-79f8-4023-b517-434f05616ec8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:12.114146 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd4a550c-79f8-4023-b517-434f05616ec8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:12.114775 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd4a550c-79f8-4023-b517-434f05616ec8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:12.505071 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cd4a550c-79f8-4023-b517-434f05616ec8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:12.519777 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cd4a550c-79f8-4023-b517-434f05616ec8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.435546 Sep 09 13:15:12.520936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 32/58] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:12 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:12.529391 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b0deba71-fe76-4ad7-bb24-87d5d98528eb req-7b40c803-1f70-424f-a0a0-7412b561e5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9110cf-907a-46bc-8e9d-31dd3c409e39", "tag": "bcff1243-0152-492c-9c36-aa3e840243d3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:12.539162 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b0deba71-fe76-4ad7-bb24-87d5d98528eb req-7b40c803-1f70-424f-a0a0-7412b561e5b1 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:12.539644 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b0deba71-fe76-4ad7-bb24-87d5d98528eb req-7b40c803-1f70-424f-a0a0-7412b561e5b1 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:12.540070 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b0deba71-fe76-4ad7-bb24-87d5d98528eb req-7b40c803-1f70-424f-a0a0-7412b561e5b1 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:12.544784 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:12.552754 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b0deba71-fe76-4ad7-bb24-87d5d98528eb req-7b40c803-1f70-424f-a0a0-7412b561e5b1 service nova] Creating event network-changed:bcff1243-0152-492c-9c36-aa3e840243d3 for instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 on hv-cinder-83124 Sep 09 13:15:12.557872 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b0deba71-fe76-4ad7-bb24-87d5d98528eb req-7b40c803-1f70-424f-a0a0-7412b561e5b1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035585 Sep 09 13:15:12.558831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 33/59] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:15:12.606750 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:15:12.608386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:15:12.609382 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:15:12.610467 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:15:12.611243 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:15:12.624971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:12.626114 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:12.626671 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:12.627551 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:12.628119 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:12.628744 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:12.651832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:15:12.658091 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for user dcb88983a8e1439588644b71170d7362 and project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:15:12.672925 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:15:12.675757 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:15:12.701764 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b857e4d4-8c41-4ed5-bb30-4760a3d247ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:12.703476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b857e4d4-8c41-4ed5-bb30-4760a3d247ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:12.715949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b857e4d4-8c41-4ed5-bb30-4760a3d247ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:12.717044 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b857e4d4-8c41-4ed5-bb30-4760a3d247ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:12.717844 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b857e4d4-8c41-4ed5-bb30-4760a3d247ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:12.718756 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b857e4d4-8c41-4ed5-bb30-4760a3d247ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:12.719458 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b857e4d4-8c41-4ed5-bb30-4760a3d247ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:12.720112 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b857e4d4-8c41-4ed5-bb30-4760a3d247ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:12.792071 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0595a0fd-f6c8-4ed5-aa77-af2d54021950 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.266618 Sep 09 13:15:12.801348 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 27/60] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:15:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 3278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:15:12.806994 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fac2185e-3972-4ed5-aeb3-ebd76099aa86 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:12.808133 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fac2185e-3972-4ed5-aeb3-ebd76099aa86 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:12.897139 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fac2185e-3972-4ed5-aeb3-ebd76099aa86 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:12.910992 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fac2185e-3972-4ed5-aeb3-ebd76099aa86 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1240 microversion: 2.1 time: 0.108487 Sep 09 13:15:12.928522 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 28/61] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:12 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1240 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:13.005675 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b857e4d4-8c41-4ed5-bb30-4760a3d247ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:13.016425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b857e4d4-8c41-4ed5-bb30-4760a3d247ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.320034 Sep 09 13:15:13.040226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 34/62] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:12 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:13.108208 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fc5f2802-3fac-451b-ac6c-b87e49558715 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:13.109038 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fc5f2802-3fac-451b-ac6c-b87e49558715 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:13.119967 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc5f2802-3fac-451b-ac6c-b87e49558715 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:13.120752 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc5f2802-3fac-451b-ac6c-b87e49558715 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:13.122683 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc5f2802-3fac-451b-ac6c-b87e49558715 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:13.123939 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc5f2802-3fac-451b-ac6c-b87e49558715 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:13.125971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc5f2802-3fac-451b-ac6c-b87e49558715 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:13.127538 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc5f2802-3fac-451b-ac6c-b87e49558715 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:13.309934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=18 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:13.315519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c0234eea-ea93-4df0-b36f-0b75948c41fa req-9b2cb86d-8e89-4693-8f0c-f1430574c6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1258804f-2f19-4ed2-94c2-0d75ea5360e5", "tag": "6111168d-48bc-4721-b702-cd5679acabff"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:13.341444 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c0234eea-ea93-4df0-b36f-0b75948c41fa req-9b2cb86d-8e89-4693-8f0c-f1430574c6b5 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:13.347061 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c0234eea-ea93-4df0-b36f-0b75948c41fa req-9b2cb86d-8e89-4693-8f0c-f1430574c6b5 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:13.349211 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c0234eea-ea93-4df0-b36f-0b75948c41fa req-9b2cb86d-8e89-4693-8f0c-f1430574c6b5 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:13.387147 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c0234eea-ea93-4df0-b36f-0b75948c41fa req-9b2cb86d-8e89-4693-8f0c-f1430574c6b5 service nova] Creating event network-changed:6111168d-48bc-4721-b702-cd5679acabff for instance 1258804f-2f19-4ed2-94c2-0d75ea5360e5 on hv-cinder-83124 Sep 09 13:15:13.398541 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c0234eea-ea93-4df0-b36f-0b75948c41fa req-9b2cb86d-8e89-4693-8f0c-f1430574c6b5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087082 Sep 09 13:15:13.399271 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 35/63] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:15:13.453438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fc5f2802-3fac-451b-ac6c-b87e49558715 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:13.461087 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fc5f2802-3fac-451b-ac6c-b87e49558715 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.357654 Sep 09 13:15:13.464251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 29/64] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:13 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:13.544281 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eadafafc-ea27-42e0-98e1-44b8f49dd8d0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:13.545356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eadafafc-ea27-42e0-98e1-44b8f49dd8d0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:13.552378 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eadafafc-ea27-42e0-98e1-44b8f49dd8d0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:13.553088 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eadafafc-ea27-42e0-98e1-44b8f49dd8d0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:13.553756 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eadafafc-ea27-42e0-98e1-44b8f49dd8d0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:13.554724 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eadafafc-ea27-42e0-98e1-44b8f49dd8d0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:13.555412 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eadafafc-ea27-42e0-98e1-44b8f49dd8d0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:13.556030 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eadafafc-ea27-42e0-98e1-44b8f49dd8d0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:13.711177 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-eadafafc-ea27-42e0-98e1-44b8f49dd8d0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:13.722642 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eadafafc-ea27-42e0-98e1-44b8f49dd8d0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.183208 Sep 09 13:15:13.735648 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 36/65] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:13 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:13.946521 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5973f378-159d-4830-803c-9ed7b051208c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:13.948039 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5973f378-159d-4830-803c-9ed7b051208c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:13.956648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5973f378-159d-4830-803c-9ed7b051208c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:13.957139 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5973f378-159d-4830-803c-9ed7b051208c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:13.957712 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5973f378-159d-4830-803c-9ed7b051208c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:13.958419 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5973f378-159d-4830-803c-9ed7b051208c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:13.958865 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5973f378-159d-4830-803c-9ed7b051208c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:13.959321 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5973f378-159d-4830-803c-9ed7b051208c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:14.050539 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5973f378-159d-4830-803c-9ed7b051208c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:14.058284 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5973f378-159d-4830-803c-9ed7b051208c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1244 microversion: 2.1 time: 0.118479 Sep 09 13:15:14.059023 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 30/66] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:13 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1244 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:14.068581 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b928c73c-c8f0-4daa-a837-26ca0576efed tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:14.070049 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b928c73c-c8f0-4daa-a837-26ca0576efed tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:14.077884 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b928c73c-c8f0-4daa-a837-26ca0576efed tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:14.078585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b928c73c-c8f0-4daa-a837-26ca0576efed tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:14.079256 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b928c73c-c8f0-4daa-a837-26ca0576efed tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:14.079965 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b928c73c-c8f0-4daa-a837-26ca0576efed tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:14.080559 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b928c73c-c8f0-4daa-a837-26ca0576efed tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:14.080994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b928c73c-c8f0-4daa-a837-26ca0576efed tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:14.225042 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b928c73c-c8f0-4daa-a837-26ca0576efed tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:14.233603 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b928c73c-c8f0-4daa-a837-26ca0576efed tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.168891 Sep 09 13:15:14.234179 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 37/67] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:14 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:14.488839 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3d6ee1c6-4027-4e6e-97bd-0fbb8fa23e66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:14.489652 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3d6ee1c6-4027-4e6e-97bd-0fbb8fa23e66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:14.495576 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3d6ee1c6-4027-4e6e-97bd-0fbb8fa23e66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:14.496131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3d6ee1c6-4027-4e6e-97bd-0fbb8fa23e66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:14.496903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3d6ee1c6-4027-4e6e-97bd-0fbb8fa23e66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:14.498136 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3d6ee1c6-4027-4e6e-97bd-0fbb8fa23e66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:14.499076 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3d6ee1c6-4027-4e6e-97bd-0fbb8fa23e66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:14.499589 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3d6ee1c6-4027-4e6e-97bd-0fbb8fa23e66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:14.654534 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3d6ee1c6-4027-4e6e-97bd-0fbb8fa23e66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:14.663580 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3d6ee1c6-4027-4e6e-97bd-0fbb8fa23e66 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.178800 Sep 09 13:15:14.665047 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 31/68] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:14 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:14.752244 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28ac8827-0d02-4db5-9c85-e3670d8b4f6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:14.753376 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-28ac8827-0d02-4db5-9c85-e3670d8b4f6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:14.759291 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28ac8827-0d02-4db5-9c85-e3670d8b4f6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:14.759779 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28ac8827-0d02-4db5-9c85-e3670d8b4f6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:14.760217 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28ac8827-0d02-4db5-9c85-e3670d8b4f6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:14.760907 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28ac8827-0d02-4db5-9c85-e3670d8b4f6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:14.761358 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28ac8827-0d02-4db5-9c85-e3670d8b4f6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:14.761908 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28ac8827-0d02-4db5-9c85-e3670d8b4f6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:14.972374 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-28ac8827-0d02-4db5-9c85-e3670d8b4f6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:14.988159 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-28ac8827-0d02-4db5-9c85-e3670d8b4f6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.239668 Sep 09 13:15:14.996139 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 38/69] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:14 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:15.083836 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b31455d7-7a7a-4ed0-9802-cc0d0812b95f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:15.084470 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b31455d7-7a7a-4ed0-9802-cc0d0812b95f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:15.090258 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b31455d7-7a7a-4ed0-9802-cc0d0812b95f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:15.091151 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b31455d7-7a7a-4ed0-9802-cc0d0812b95f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:15.091602 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b31455d7-7a7a-4ed0-9802-cc0d0812b95f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:15.092306 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b31455d7-7a7a-4ed0-9802-cc0d0812b95f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:15.092765 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b31455d7-7a7a-4ed0-9802-cc0d0812b95f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:15.093201 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b31455d7-7a7a-4ed0-9802-cc0d0812b95f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:15.158101 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b31455d7-7a7a-4ed0-9802-cc0d0812b95f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:15.166340 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b31455d7-7a7a-4ed0-9802-cc0d0812b95f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1244 microversion: 2.1 time: 0.086324 Sep 09 13:15:15.166806 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 32/70] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:15 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:15.258026 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bc6a70f2-263a-4022-b6f6-b47cb9fa117c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:15.258724 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bc6a70f2-263a-4022-b6f6-b47cb9fa117c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:15.265508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc6a70f2-263a-4022-b6f6-b47cb9fa117c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:15.266186 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc6a70f2-263a-4022-b6f6-b47cb9fa117c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:15.266611 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc6a70f2-263a-4022-b6f6-b47cb9fa117c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:15.267333 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc6a70f2-263a-4022-b6f6-b47cb9fa117c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:15.267786 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc6a70f2-263a-4022-b6f6-b47cb9fa117c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:15.268207 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc6a70f2-263a-4022-b6f6-b47cb9fa117c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:15.430437 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bc6a70f2-263a-4022-b6f6-b47cb9fa117c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:15.441292 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bc6a70f2-263a-4022-b6f6-b47cb9fa117c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.186716 Sep 09 13:15:15.442231 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 39/71] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:15 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:15.688121 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-22131793-e98d-49d7-a727-dced41ed7934 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:15.688742 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-22131793-e98d-49d7-a727-dced41ed7934 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:15.694621 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22131793-e98d-49d7-a727-dced41ed7934 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:15.695134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22131793-e98d-49d7-a727-dced41ed7934 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:15.695580 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22131793-e98d-49d7-a727-dced41ed7934 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:15.696271 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22131793-e98d-49d7-a727-dced41ed7934 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:15.696727 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22131793-e98d-49d7-a727-dced41ed7934 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:15.697155 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22131793-e98d-49d7-a727-dced41ed7934 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:15.702826 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=83 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:15.833509 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-22131793-e98d-49d7-a727-dced41ed7934 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:15.841363 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-22131793-e98d-49d7-a727-dced41ed7934 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.157534 Sep 09 13:15:15.841988 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 33/72] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:15 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:16.018249 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1ca00d8c-e9e7-4f9a-ad0c-567c6aac412a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:16.018940 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1ca00d8c-e9e7-4f9a-ad0c-567c6aac412a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:16.029281 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ca00d8c-e9e7-4f9a-ad0c-567c6aac412a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:16.029776 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ca00d8c-e9e7-4f9a-ad0c-567c6aac412a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:16.030251 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ca00d8c-e9e7-4f9a-ad0c-567c6aac412a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:16.030973 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ca00d8c-e9e7-4f9a-ad0c-567c6aac412a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:16.031447 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ca00d8c-e9e7-4f9a-ad0c-567c6aac412a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:16.031898 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1ca00d8c-e9e7-4f9a-ad0c-567c6aac412a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:16.170239 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1ca00d8c-e9e7-4f9a-ad0c-567c6aac412a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:16.180551 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1ca00d8c-e9e7-4f9a-ad0c-567c6aac412a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.165942 Sep 09 13:15:16.181345 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 40/73] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:16 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:16.189593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-71554068-79dd-4367-913e-c477114d4819 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:16.191090 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-71554068-79dd-4367-913e-c477114d4819 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:16.197619 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-71554068-79dd-4367-913e-c477114d4819 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:16.198194 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-71554068-79dd-4367-913e-c477114d4819 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:16.198639 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-71554068-79dd-4367-913e-c477114d4819 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:16.199365 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-71554068-79dd-4367-913e-c477114d4819 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:16.199864 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-71554068-79dd-4367-913e-c477114d4819 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:16.200294 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-71554068-79dd-4367-913e-c477114d4819 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:16.262074 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-71554068-79dd-4367-913e-c477114d4819 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:16.271018 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-71554068-79dd-4367-913e-c477114d4819 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1244 microversion: 2.1 time: 0.085063 Sep 09 13:15:16.271675 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 34/74] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:16 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:16.466251 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c6d1898f-489b-4921-bca2-0c4f54f67a65 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:16.467423 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c6d1898f-489b-4921-bca2-0c4f54f67a65 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:16.475451 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6d1898f-489b-4921-bca2-0c4f54f67a65 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:16.475959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6d1898f-489b-4921-bca2-0c4f54f67a65 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:16.476390 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6d1898f-489b-4921-bca2-0c4f54f67a65 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:16.477675 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6d1898f-489b-4921-bca2-0c4f54f67a65 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:16.478954 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6d1898f-489b-4921-bca2-0c4f54f67a65 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:16.479335 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6d1898f-489b-4921-bca2-0c4f54f67a65 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:16.648934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c6d1898f-489b-4921-bca2-0c4f54f67a65 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:16.656814 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c6d1898f-489b-4921-bca2-0c4f54f67a65 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.195104 Sep 09 13:15:16.657388 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 41/75] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:16 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:16.863817 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2f4481a9-5407-47a9-8655-08a0b23c3897 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:16.864430 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2f4481a9-5407-47a9-8655-08a0b23c3897 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:16.870975 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f4481a9-5407-47a9-8655-08a0b23c3897 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:16.871628 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f4481a9-5407-47a9-8655-08a0b23c3897 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:16.872683 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f4481a9-5407-47a9-8655-08a0b23c3897 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:16.873411 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f4481a9-5407-47a9-8655-08a0b23c3897 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:16.873872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f4481a9-5407-47a9-8655-08a0b23c3897 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:16.874301 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f4481a9-5407-47a9-8655-08a0b23c3897 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:17.015010 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2f4481a9-5407-47a9-8655-08a0b23c3897 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:17.022825 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2f4481a9-5407-47a9-8655-08a0b23c3897 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.163166 Sep 09 13:15:17.023466 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 35/76] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:16 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:17.203757 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28acaf48-8e2a-48f6-a46f-0f4846281156 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:17.204372 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-28acaf48-8e2a-48f6-a46f-0f4846281156 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:17.210446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28acaf48-8e2a-48f6-a46f-0f4846281156 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:17.210925 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28acaf48-8e2a-48f6-a46f-0f4846281156 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:17.211513 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28acaf48-8e2a-48f6-a46f-0f4846281156 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:17.212209 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28acaf48-8e2a-48f6-a46f-0f4846281156 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:17.212658 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28acaf48-8e2a-48f6-a46f-0f4846281156 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:17.213078 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28acaf48-8e2a-48f6-a46f-0f4846281156 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:17.294014 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-103838e4-6de6-460c-94a9-2f5117869c59 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:17.294843 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-103838e4-6de6-460c-94a9-2f5117869c59 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:17.301144 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-103838e4-6de6-460c-94a9-2f5117869c59 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:17.301633 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-103838e4-6de6-460c-94a9-2f5117869c59 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:17.302071 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-103838e4-6de6-460c-94a9-2f5117869c59 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:17.302771 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-103838e4-6de6-460c-94a9-2f5117869c59 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:17.303318 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-103838e4-6de6-460c-94a9-2f5117869c59 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:17.303884 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-103838e4-6de6-460c-94a9-2f5117869c59 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:17.353649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-28acaf48-8e2a-48f6-a46f-0f4846281156 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:17.362141 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-28acaf48-8e2a-48f6-a46f-0f4846281156 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.162578 Sep 09 13:15:17.374045 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-103838e4-6de6-460c-94a9-2f5117869c59 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:17.377925 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 42/77] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:17 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:17.381575 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-103838e4-6de6-460c-94a9-2f5117869c59 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1244 microversion: 2.1 time: 0.091728 Sep 09 13:15:17.382137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 36/78] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:17 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:17.682810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3fa6b24c-6362-470f-985b-e51f423d4634 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:17.683492 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3fa6b24c-6362-470f-985b-e51f423d4634 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:17.689657 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fa6b24c-6362-470f-985b-e51f423d4634 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:17.690146 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fa6b24c-6362-470f-985b-e51f423d4634 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:17.690580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fa6b24c-6362-470f-985b-e51f423d4634 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:17.691505 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fa6b24c-6362-470f-985b-e51f423d4634 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:17.691963 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fa6b24c-6362-470f-985b-e51f423d4634 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:17.692386 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fa6b24c-6362-470f-985b-e51f423d4634 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:17.714088 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:17.881567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3fa6b24c-6362-470f-985b-e51f423d4634 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:17.890110 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3fa6b24c-6362-470f-985b-e51f423d4634 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.213332 Sep 09 13:15:17.890685 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 43/79] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:17 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:18.047903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bbc493f3-58d8-49df-8a78-808f54d88d7b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:18.048537 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bbc493f3-58d8-49df-8a78-808f54d88d7b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:18.054568 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bbc493f3-58d8-49df-8a78-808f54d88d7b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:18.055079 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bbc493f3-58d8-49df-8a78-808f54d88d7b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:18.055761 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bbc493f3-58d8-49df-8a78-808f54d88d7b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:18.056464 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bbc493f3-58d8-49df-8a78-808f54d88d7b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:18.056924 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bbc493f3-58d8-49df-8a78-808f54d88d7b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:18.057355 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bbc493f3-58d8-49df-8a78-808f54d88d7b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:18.201325 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bbc493f3-58d8-49df-8a78-808f54d88d7b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:18.209959 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bbc493f3-58d8-49df-8a78-808f54d88d7b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.165824 Sep 09 13:15:18.210792 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 37/80] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:18 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:18.387604 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-18fd5ed7-d832-469d-9f2b-1c7e25876689 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:18.388885 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-18fd5ed7-d832-469d-9f2b-1c7e25876689 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:18.395954 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18fd5ed7-d832-469d-9f2b-1c7e25876689 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:18.396498 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18fd5ed7-d832-469d-9f2b-1c7e25876689 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:18.397047 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18fd5ed7-d832-469d-9f2b-1c7e25876689 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:18.397784 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18fd5ed7-d832-469d-9f2b-1c7e25876689 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:18.398494 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18fd5ed7-d832-469d-9f2b-1c7e25876689 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:18.399096 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18fd5ed7-d832-469d-9f2b-1c7e25876689 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:18.409107 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6d419e42-853c-4c58-87de-7c374510b869 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:18.410309 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6d419e42-853c-4c58-87de-7c374510b869 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:18.418124 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6d419e42-853c-4c58-87de-7c374510b869 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:18.419577 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6d419e42-853c-4c58-87de-7c374510b869 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:18.420118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6d419e42-853c-4c58-87de-7c374510b869 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:18.420886 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6d419e42-853c-4c58-87de-7c374510b869 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:18.421423 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6d419e42-853c-4c58-87de-7c374510b869 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:18.421920 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6d419e42-853c-4c58-87de-7c374510b869 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:18.517134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6d419e42-853c-4c58-87de-7c374510b869 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:18.531381 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6d419e42-853c-4c58-87de-7c374510b869 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1236 microversion: 2.1 time: 0.129109 Sep 09 13:15:18.532288 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 38/81] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:18 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1236 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:18.582632 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-18fd5ed7-d832-469d-9f2b-1c7e25876689 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:18.591227 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-18fd5ed7-d832-469d-9f2b-1c7e25876689 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.210361 Sep 09 13:15:18.591812 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 44/82] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:18 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:18.913294 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fe6b175e-5cd4-4830-871c-cef5a7541bf9 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:18.913950 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fe6b175e-5cd4-4830-871c-cef5a7541bf9 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:18.920474 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe6b175e-5cd4-4830-871c-cef5a7541bf9 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:18.921040 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe6b175e-5cd4-4830-871c-cef5a7541bf9 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:18.921389 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe6b175e-5cd4-4830-871c-cef5a7541bf9 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:18.922083 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe6b175e-5cd4-4830-871c-cef5a7541bf9 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:18.922542 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe6b175e-5cd4-4830-871c-cef5a7541bf9 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:18.922970 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe6b175e-5cd4-4830-871c-cef5a7541bf9 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:19.063215 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fe6b175e-5cd4-4830-871c-cef5a7541bf9 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:19.070781 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fe6b175e-5cd4-4830-871c-cef5a7541bf9 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.161249 Sep 09 13:15:19.071364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 39/83] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:18 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:19.234099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8cb2f65c-45e4-4821-963d-e879ec77144b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:19.234764 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8cb2f65c-45e4-4821-963d-e879ec77144b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:19.241064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cb2f65c-45e4-4821-963d-e879ec77144b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:19.241555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cb2f65c-45e4-4821-963d-e879ec77144b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:19.242001 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cb2f65c-45e4-4821-963d-e879ec77144b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:19.242701 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cb2f65c-45e4-4821-963d-e879ec77144b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:19.243185 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cb2f65c-45e4-4821-963d-e879ec77144b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:19.243635 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8cb2f65c-45e4-4821-963d-e879ec77144b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:19.376798 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8cb2f65c-45e4-4821-963d-e879ec77144b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:19.384703 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8cb2f65c-45e4-4821-963d-e879ec77144b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.154637 Sep 09 13:15:19.385790 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 45/84] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:19 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:19.555019 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2fad8871-e814-448d-9872-4582d0d157b2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:19.555703 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2fad8871-e814-448d-9872-4582d0d157b2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:19.562281 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fad8871-e814-448d-9872-4582d0d157b2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:19.562761 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fad8871-e814-448d-9872-4582d0d157b2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:19.563219 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fad8871-e814-448d-9872-4582d0d157b2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:19.563907 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fad8871-e814-448d-9872-4582d0d157b2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:19.564357 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fad8871-e814-448d-9872-4582d0d157b2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:19.564783 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fad8871-e814-448d-9872-4582d0d157b2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:19.616297 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-da8ca4d0-0ab8-4633-9078-cae9b8ff6de4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:19.617048 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-da8ca4d0-0ab8-4633-9078-cae9b8ff6de4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:19.624001 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da8ca4d0-0ab8-4633-9078-cae9b8ff6de4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:19.624482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da8ca4d0-0ab8-4633-9078-cae9b8ff6de4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:19.625029 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da8ca4d0-0ab8-4633-9078-cae9b8ff6de4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:19.625606 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da8ca4d0-0ab8-4633-9078-cae9b8ff6de4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:19.626229 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da8ca4d0-0ab8-4633-9078-cae9b8ff6de4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:19.626789 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-da8ca4d0-0ab8-4633-9078-cae9b8ff6de4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:19.635167 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2fad8871-e814-448d-9872-4582d0d157b2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:19.643846 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2fad8871-e814-448d-9872-4582d0d157b2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1236 microversion: 2.1 time: 0.092618 Sep 09 13:15:19.644413 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 40/85] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:19 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1236 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:19.787480 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-da8ca4d0-0ab8-4633-9078-cae9b8ff6de4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:19.788719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-da8ca4d0-0ab8-4633-9078-cae9b8ff6de4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.176476 Sep 09 13:15:19.789445 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 46/86] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:19 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:20.093733 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-72498dd8-a911-4fa8-b7c6-3743ae551415 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:20.094347 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-72498dd8-a911-4fa8-b7c6-3743ae551415 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:20.100211 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72498dd8-a911-4fa8-b7c6-3743ae551415 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:20.100686 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72498dd8-a911-4fa8-b7c6-3743ae551415 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:20.101117 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72498dd8-a911-4fa8-b7c6-3743ae551415 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:20.101797 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72498dd8-a911-4fa8-b7c6-3743ae551415 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:20.102270 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72498dd8-a911-4fa8-b7c6-3743ae551415 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:20.102687 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72498dd8-a911-4fa8-b7c6-3743ae551415 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:20.227397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-72498dd8-a911-4fa8-b7c6-3743ae551415 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:20.234907 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-72498dd8-a911-4fa8-b7c6-3743ae551415 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.145814 Sep 09 13:15:20.235501 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 41/87] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:20 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:20.409595 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db335cee-0403-4e41-afcc-18ab1a5f2aa3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:20.410155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db335cee-0403-4e41-afcc-18ab1a5f2aa3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:20.415991 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db335cee-0403-4e41-afcc-18ab1a5f2aa3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:20.416474 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db335cee-0403-4e41-afcc-18ab1a5f2aa3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:20.416902 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db335cee-0403-4e41-afcc-18ab1a5f2aa3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:20.417578 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db335cee-0403-4e41-afcc-18ab1a5f2aa3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:20.418023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db335cee-0403-4e41-afcc-18ab1a5f2aa3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:20.418442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db335cee-0403-4e41-afcc-18ab1a5f2aa3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:20.547541 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-db335cee-0403-4e41-afcc-18ab1a5f2aa3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:20.554986 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db335cee-0403-4e41-afcc-18ab1a5f2aa3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.149308 Sep 09 13:15:20.555564 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 47/88] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:20 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:20.670458 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a5ae1459-b7eb-45f8-8434-cd538e183103 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:20.671036 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a5ae1459-b7eb-45f8-8434-cd538e183103 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:20.677014 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5ae1459-b7eb-45f8-8434-cd538e183103 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:20.677498 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5ae1459-b7eb-45f8-8434-cd538e183103 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:20.677934 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5ae1459-b7eb-45f8-8434-cd538e183103 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:20.678621 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5ae1459-b7eb-45f8-8434-cd538e183103 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:20.679100 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5ae1459-b7eb-45f8-8434-cd538e183103 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:20.679530 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5ae1459-b7eb-45f8-8434-cd538e183103 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:20.740047 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a5ae1459-b7eb-45f8-8434-cd538e183103 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:20.748100 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a5ae1459-b7eb-45f8-8434-cd538e183103 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1236 microversion: 2.1 time: 0.081510 Sep 09 13:15:20.748667 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 42/89] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:20 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1236 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:20.813963 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-98287318-b273-42fe-a678-2dfa3e7c2289 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:20.814601 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-98287318-b273-42fe-a678-2dfa3e7c2289 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:20.821087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98287318-b273-42fe-a678-2dfa3e7c2289 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:20.821610 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98287318-b273-42fe-a678-2dfa3e7c2289 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:20.822115 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98287318-b273-42fe-a678-2dfa3e7c2289 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:20.823033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98287318-b273-42fe-a678-2dfa3e7c2289 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:20.823683 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98287318-b273-42fe-a678-2dfa3e7c2289 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:20.824153 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98287318-b273-42fe-a678-2dfa3e7c2289 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:20.955163 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-98287318-b273-42fe-a678-2dfa3e7c2289 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:20.962679 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-98287318-b273-42fe-a678-2dfa3e7c2289 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.153527 Sep 09 13:15:20.963277 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 48/90] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:20 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:21.258702 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-19e5505a-91eb-4f41-b131-041f95ffba1d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:21.259444 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-19e5505a-91eb-4f41-b131-041f95ffba1d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:21.265788 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-19e5505a-91eb-4f41-b131-041f95ffba1d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:21.266460 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-19e5505a-91eb-4f41-b131-041f95ffba1d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:21.266800 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-19e5505a-91eb-4f41-b131-041f95ffba1d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:21.267527 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-19e5505a-91eb-4f41-b131-041f95ffba1d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:21.268006 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-19e5505a-91eb-4f41-b131-041f95ffba1d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:21.268413 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-19e5505a-91eb-4f41-b131-041f95ffba1d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:21.401120 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-19e5505a-91eb-4f41-b131-041f95ffba1d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:21.408726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-19e5505a-91eb-4f41-b131-041f95ffba1d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.154091 Sep 09 13:15:21.409289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 43/91] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:21 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:21.577781 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-060a37ec-9415-4515-b445-8d3f0f49abf4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:21.578322 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-060a37ec-9415-4515-b445-8d3f0f49abf4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:21.584276 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-060a37ec-9415-4515-b445-8d3f0f49abf4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:21.584766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-060a37ec-9415-4515-b445-8d3f0f49abf4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:21.585206 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-060a37ec-9415-4515-b445-8d3f0f49abf4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:21.585897 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-060a37ec-9415-4515-b445-8d3f0f49abf4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:21.586353 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-060a37ec-9415-4515-b445-8d3f0f49abf4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:21.586779 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-060a37ec-9415-4515-b445-8d3f0f49abf4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:21.719288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-060a37ec-9415-4515-b445-8d3f0f49abf4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:21.726808 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-060a37ec-9415-4515-b445-8d3f0f49abf4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.152918 Sep 09 13:15:21.727408 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 49/92] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:21 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:21.771406 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bc404742-01c0-4b14-a34a-4ae040a8869f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:21.772042 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bc404742-01c0-4b14-a34a-4ae040a8869f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:21.777833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc404742-01c0-4b14-a34a-4ae040a8869f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:21.778341 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc404742-01c0-4b14-a34a-4ae040a8869f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:21.778782 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc404742-01c0-4b14-a34a-4ae040a8869f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:21.779501 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc404742-01c0-4b14-a34a-4ae040a8869f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:21.779959 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc404742-01c0-4b14-a34a-4ae040a8869f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:21.780389 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc404742-01c0-4b14-a34a-4ae040a8869f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:21.842417 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bc404742-01c0-4b14-a34a-4ae040a8869f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:21.850112 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bc404742-01c0-4b14-a34a-4ae040a8869f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1236 microversion: 2.1 time: 0.082501 Sep 09 13:15:21.850703 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 44/93] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:21 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1236 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:21.987291 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-550e0109-cb5e-463e-a589-f2d407b458d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:21.987916 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-550e0109-cb5e-463e-a589-f2d407b458d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:21.994272 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-550e0109-cb5e-463e-a589-f2d407b458d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:21.994758 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-550e0109-cb5e-463e-a589-f2d407b458d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:21.995239 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-550e0109-cb5e-463e-a589-f2d407b458d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:21.995944 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-550e0109-cb5e-463e-a589-f2d407b458d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:21.996397 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-550e0109-cb5e-463e-a589-f2d407b458d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:21.996814 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-550e0109-cb5e-463e-a589-f2d407b458d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:22.128856 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-550e0109-cb5e-463e-a589-f2d407b458d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:22.136298 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-550e0109-cb5e-463e-a589-f2d407b458d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.153220 Sep 09 13:15:22.136855 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 50/94] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:21 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:22.431633 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d52a863e-74f5-4676-9966-b3c7ccc2c3d1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:22.432248 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d52a863e-74f5-4676-9966-b3c7ccc2c3d1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:22.438599 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d52a863e-74f5-4676-9966-b3c7ccc2c3d1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:22.439099 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d52a863e-74f5-4676-9966-b3c7ccc2c3d1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:22.439540 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d52a863e-74f5-4676-9966-b3c7ccc2c3d1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:22.440221 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d52a863e-74f5-4676-9966-b3c7ccc2c3d1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:22.440670 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d52a863e-74f5-4676-9966-b3c7ccc2c3d1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:22.441097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d52a863e-74f5-4676-9966-b3c7ccc2c3d1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:22.567124 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d52a863e-74f5-4676-9966-b3c7ccc2c3d1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:22.574735 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d52a863e-74f5-4676-9966-b3c7ccc2c3d1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.146979 Sep 09 13:15:22.575908 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 45/95] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:22 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:22.751035 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0fb20df-7f81-4e50-aad0-1d3f40526df0 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:22.751650 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c0fb20df-7f81-4e50-aad0-1d3f40526df0 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:22.757486 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0fb20df-7f81-4e50-aad0-1d3f40526df0 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:22.757959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0fb20df-7f81-4e50-aad0-1d3f40526df0 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:22.758385 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0fb20df-7f81-4e50-aad0-1d3f40526df0 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:22.759073 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0fb20df-7f81-4e50-aad0-1d3f40526df0 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:22.759531 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0fb20df-7f81-4e50-aad0-1d3f40526df0 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:22.759946 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0fb20df-7f81-4e50-aad0-1d3f40526df0 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:22.764503 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:22.878611 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-04562a4e-e47d-4ac5-b4fc-4a88e27ccbfd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:22.880126 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-04562a4e-e47d-4ac5-b4fc-4a88e27ccbfd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:22.882061 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=6 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:22.893063 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04562a4e-e47d-4ac5-b4fc-4a88e27ccbfd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:22.893063 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04562a4e-e47d-4ac5-b4fc-4a88e27ccbfd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:22.893063 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04562a4e-e47d-4ac5-b4fc-4a88e27ccbfd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:22.893063 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04562a4e-e47d-4ac5-b4fc-4a88e27ccbfd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:22.893346 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04562a4e-e47d-4ac5-b4fc-4a88e27ccbfd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:22.893346 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04562a4e-e47d-4ac5-b4fc-4a88e27ccbfd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:22.904651 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c0fb20df-7f81-4e50-aad0-1d3f40526df0 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:22.908332 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=8 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:22.913603 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0fb20df-7f81-4e50-aad0-1d3f40526df0 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.166941 Sep 09 13:15:22.914168 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 51/96] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:22 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:22.961317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-04562a4e-e47d-4ac5-b4fc-4a88e27ccbfd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:22.969253 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-04562a4e-e47d-4ac5-b4fc-4a88e27ccbfd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1236 microversion: 2.1 time: 0.095931 Sep 09 13:15:22.969824 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 46/97] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:22 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1236 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:23.159087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-76b408ee-b380-4fa3-9c4a-8e129693b432 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:23.159770 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-76b408ee-b380-4fa3-9c4a-8e129693b432 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:23.165787 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76b408ee-b380-4fa3-9c4a-8e129693b432 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:23.166265 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76b408ee-b380-4fa3-9c4a-8e129693b432 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:23.166732 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76b408ee-b380-4fa3-9c4a-8e129693b432 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:23.167439 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76b408ee-b380-4fa3-9c4a-8e129693b432 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:23.167888 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76b408ee-b380-4fa3-9c4a-8e129693b432 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:23.168332 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76b408ee-b380-4fa3-9c4a-8e129693b432 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:23.295507 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-76b408ee-b380-4fa3-9c4a-8e129693b432 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:23.302924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-76b408ee-b380-4fa3-9c4a-8e129693b432 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.147676 Sep 09 13:15:23.303509 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 52/98] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:23 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:23.597987 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d51868c6-e96e-4199-bc10-09ac911f50c1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:23.598719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d51868c6-e96e-4199-bc10-09ac911f50c1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:23.604846 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d51868c6-e96e-4199-bc10-09ac911f50c1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:23.605331 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d51868c6-e96e-4199-bc10-09ac911f50c1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:23.605777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d51868c6-e96e-4199-bc10-09ac911f50c1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:23.606502 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d51868c6-e96e-4199-bc10-09ac911f50c1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:23.606958 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d51868c6-e96e-4199-bc10-09ac911f50c1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:23.607410 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d51868c6-e96e-4199-bc10-09ac911f50c1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:23.737579 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d51868c6-e96e-4199-bc10-09ac911f50c1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:23.745059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d51868c6-e96e-4199-bc10-09ac911f50c1 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.150956 Sep 09 13:15:23.745621 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 47/99] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:23 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:23.941084 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14a3d470-ec2c-4564-a764-b3ad51199f96 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:23.941084 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-14a3d470-ec2c-4564-a764-b3ad51199f96 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:23.946620 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14a3d470-ec2c-4564-a764-b3ad51199f96 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:23.947365 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14a3d470-ec2c-4564-a764-b3ad51199f96 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:23.947964 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14a3d470-ec2c-4564-a764-b3ad51199f96 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:23.948651 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14a3d470-ec2c-4564-a764-b3ad51199f96 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:23.949135 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14a3d470-ec2c-4564-a764-b3ad51199f96 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:23.949564 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14a3d470-ec2c-4564-a764-b3ad51199f96 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:23.996291 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-032fadde-130c-401b-801c-15e43c211b87 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:23.997631 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-032fadde-130c-401b-801c-15e43c211b87 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:24.008141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-032fadde-130c-401b-801c-15e43c211b87 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:24.008755 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-032fadde-130c-401b-801c-15e43c211b87 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:24.009263 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-032fadde-130c-401b-801c-15e43c211b87 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:24.010844 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-032fadde-130c-401b-801c-15e43c211b87 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:24.011700 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-032fadde-130c-401b-801c-15e43c211b87 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:24.012199 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-032fadde-130c-401b-801c-15e43c211b87 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:24.120855 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-14a3d470-ec2c-4564-a764-b3ad51199f96 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:24.132096 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14a3d470-ec2c-4564-a764-b3ad51199f96 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.198889 Sep 09 13:15:24.135429 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 53/100] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:23 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:24.151945 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-032fadde-130c-401b-801c-15e43c211b87 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:24.162648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-032fadde-130c-401b-801c-15e43c211b87 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1236 microversion: 2.1 time: 0.173269 Sep 09 13:15:24.163433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 48/101] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:23 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1236 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:24.325807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26dcbb53-7c23-4c75-a23d-6b56e2f6f90d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:24.326427 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-26dcbb53-7c23-4c75-a23d-6b56e2f6f90d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:24.332741 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26dcbb53-7c23-4c75-a23d-6b56e2f6f90d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:24.333241 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26dcbb53-7c23-4c75-a23d-6b56e2f6f90d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:24.333680 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26dcbb53-7c23-4c75-a23d-6b56e2f6f90d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:24.334365 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26dcbb53-7c23-4c75-a23d-6b56e2f6f90d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:24.334993 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26dcbb53-7c23-4c75-a23d-6b56e2f6f90d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:24.335445 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26dcbb53-7c23-4c75-a23d-6b56e2f6f90d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:24.488218 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-26dcbb53-7c23-4c75-a23d-6b56e2f6f90d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:24.501526 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-26dcbb53-7c23-4c75-a23d-6b56e2f6f90d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.179646 Sep 09 13:15:24.502290 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 54/102] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:24 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:24.768174 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f35120e0-d5fb-4b62-b211-353928bf3b86 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:24.769057 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f35120e0-d5fb-4b62-b211-353928bf3b86 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:24.788951 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f35120e0-d5fb-4b62-b211-353928bf3b86 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:24.792137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f35120e0-d5fb-4b62-b211-353928bf3b86 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:24.792751 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f35120e0-d5fb-4b62-b211-353928bf3b86 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:24.795949 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f35120e0-d5fb-4b62-b211-353928bf3b86 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:24.796428 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f35120e0-d5fb-4b62-b211-353928bf3b86 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:24.796869 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f35120e0-d5fb-4b62-b211-353928bf3b86 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:25.157601 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-32a21933-3ef8-409a-b98e-2d3bb4c018e7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:25.158620 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-32a21933-3ef8-409a-b98e-2d3bb4c018e7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:25.166251 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32a21933-3ef8-409a-b98e-2d3bb4c018e7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:25.167289 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32a21933-3ef8-409a-b98e-2d3bb4c018e7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:25.167883 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32a21933-3ef8-409a-b98e-2d3bb4c018e7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:25.169692 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32a21933-3ef8-409a-b98e-2d3bb4c018e7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:25.170585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32a21933-3ef8-409a-b98e-2d3bb4c018e7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:25.171311 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32a21933-3ef8-409a-b98e-2d3bb4c018e7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:25.303647 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f35120e0-d5fb-4b62-b211-353928bf3b86 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:25.305346 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:25.320805 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f35120e0-d5fb-4b62-b211-353928bf3b86 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.556051 Sep 09 13:15:25.324287 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 49/103] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:24 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:25.333541 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a102450d-bac5-48c9-87b9-5325e7eeaa9f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:25.334505 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a102450d-bac5-48c9-87b9-5325e7eeaa9f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:25.344860 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a102450d-bac5-48c9-87b9-5325e7eeaa9f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:25.345828 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a102450d-bac5-48c9-87b9-5325e7eeaa9f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:25.349236 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a102450d-bac5-48c9-87b9-5325e7eeaa9f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:25.354296 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a102450d-bac5-48c9-87b9-5325e7eeaa9f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:25.357877 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a102450d-bac5-48c9-87b9-5325e7eeaa9f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:25.358541 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a102450d-bac5-48c9-87b9-5325e7eeaa9f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:25.388820 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-32a21933-3ef8-409a-b98e-2d3bb4c018e7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:25.410069 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-32a21933-3ef8-409a-b98e-2d3bb4c018e7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.257005 Sep 09 13:15:25.413158 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 55/104] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:25 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:25.525146 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-60e9cf56-6ecf-46af-8bc2-203043766f57 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:25.525766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-60e9cf56-6ecf-46af-8bc2-203043766f57 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:25.541003 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60e9cf56-6ecf-46af-8bc2-203043766f57 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:25.541513 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60e9cf56-6ecf-46af-8bc2-203043766f57 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:25.541948 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60e9cf56-6ecf-46af-8bc2-203043766f57 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:25.547953 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60e9cf56-6ecf-46af-8bc2-203043766f57 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:25.548472 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60e9cf56-6ecf-46af-8bc2-203043766f57 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:25.549398 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60e9cf56-6ecf-46af-8bc2-203043766f57 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:25.694489 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a102450d-bac5-48c9-87b9-5325e7eeaa9f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:25.719299 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a102450d-bac5-48c9-87b9-5325e7eeaa9f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1300 microversion: 2.1 time: 0.392252 Sep 09 13:15:25.720943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 50/105] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:25 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1300 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:25.791589 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-60e9cf56-6ecf-46af-8bc2-203043766f57 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:25.814843 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-60e9cf56-6ecf-46af-8bc2-203043766f57 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.292950 Sep 09 13:15:25.816881 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 56/106] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:25 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:26.357179 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4521098a-eb4b-44ae-9095-2e338c8622ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:26.359560 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4521098a-eb4b-44ae-9095-2e338c8622ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:26.368054 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4521098a-eb4b-44ae-9095-2e338c8622ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:26.368952 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4521098a-eb4b-44ae-9095-2e338c8622ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:26.369081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4521098a-eb4b-44ae-9095-2e338c8622ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:26.369725 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4521098a-eb4b-44ae-9095-2e338c8622ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:26.370183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4521098a-eb4b-44ae-9095-2e338c8622ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:26.370606 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4521098a-eb4b-44ae-9095-2e338c8622ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:26.442657 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-63ae785b-e938-4121-8cf0-572e32f1e2b4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:26.442657 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-63ae785b-e938-4121-8cf0-572e32f1e2b4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:26.447550 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63ae785b-e938-4121-8cf0-572e32f1e2b4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:26.448251 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63ae785b-e938-4121-8cf0-572e32f1e2b4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:26.448896 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63ae785b-e938-4121-8cf0-572e32f1e2b4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:26.449797 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63ae785b-e938-4121-8cf0-572e32f1e2b4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:26.450339 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63ae785b-e938-4121-8cf0-572e32f1e2b4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:26.451062 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-63ae785b-e938-4121-8cf0-572e32f1e2b4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:26.527665 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4521098a-eb4b-44ae-9095-2e338c8622ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:26.535743 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4521098a-eb4b-44ae-9095-2e338c8622ba tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.184043 Sep 09 13:15:26.536325 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 51/107] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:26 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:26.599635 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-63ae785b-e938-4121-8cf0-572e32f1e2b4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:26.607680 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-63ae785b-e938-4121-8cf0-572e32f1e2b4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.170703 Sep 09 13:15:26.617377 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 57/108] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:26 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:26.744780 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e8793d48-b75f-426d-bdeb-ba19ead357e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:26.745398 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e8793d48-b75f-426d-bdeb-ba19ead357e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:26.751357 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e8793d48-b75f-426d-bdeb-ba19ead357e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:26.751846 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e8793d48-b75f-426d-bdeb-ba19ead357e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:26.752281 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e8793d48-b75f-426d-bdeb-ba19ead357e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:26.752976 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e8793d48-b75f-426d-bdeb-ba19ead357e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:26.753428 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e8793d48-b75f-426d-bdeb-ba19ead357e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:26.753850 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e8793d48-b75f-426d-bdeb-ba19ead357e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:26.827162 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e8793d48-b75f-426d-bdeb-ba19ead357e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:26.834766 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e8793d48-b75f-426d-bdeb-ba19ead357e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1298 microversion: 2.1 time: 0.093716 Sep 09 13:15:26.835699 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 52/109] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:26 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:26.841335 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0845c988-5912-4fc7-b900-0a69178ecc5b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:26.841960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0845c988-5912-4fc7-b900-0a69178ecc5b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:26.847979 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0845c988-5912-4fc7-b900-0a69178ecc5b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:26.848464 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0845c988-5912-4fc7-b900-0a69178ecc5b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:26.848900 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0845c988-5912-4fc7-b900-0a69178ecc5b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:26.849813 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0845c988-5912-4fc7-b900-0a69178ecc5b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:26.850456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0845c988-5912-4fc7-b900-0a69178ecc5b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:26.850882 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0845c988-5912-4fc7-b900-0a69178ecc5b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:26.999690 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0845c988-5912-4fc7-b900-0a69178ecc5b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:27.008626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0845c988-5912-4fc7-b900-0a69178ecc5b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.171940 Sep 09 13:15:27.009208 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 58/110] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:26 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:27.559038 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4c3caa1b-a4bb-4245-ac2a-735c89025100 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:27.560381 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4c3caa1b-a4bb-4245-ac2a-735c89025100 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:27.566397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4c3caa1b-a4bb-4245-ac2a-735c89025100 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:27.566885 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4c3caa1b-a4bb-4245-ac2a-735c89025100 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:27.567372 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4c3caa1b-a4bb-4245-ac2a-735c89025100 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:27.568065 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4c3caa1b-a4bb-4245-ac2a-735c89025100 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:27.568524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4c3caa1b-a4bb-4245-ac2a-735c89025100 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:27.568951 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4c3caa1b-a4bb-4245-ac2a-735c89025100 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:27.634576 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c3629d5d-2d8c-4b74-92ef-30f030292bda tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:27.635246 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c3629d5d-2d8c-4b74-92ef-30f030292bda tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:27.643580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3629d5d-2d8c-4b74-92ef-30f030292bda tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:27.644100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3629d5d-2d8c-4b74-92ef-30f030292bda tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:27.644536 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3629d5d-2d8c-4b74-92ef-30f030292bda tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:27.645239 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3629d5d-2d8c-4b74-92ef-30f030292bda tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:27.645700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3629d5d-2d8c-4b74-92ef-30f030292bda tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:27.646176 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3629d5d-2d8c-4b74-92ef-30f030292bda tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:27.710213 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4c3caa1b-a4bb-4245-ac2a-735c89025100 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:27.719760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4c3caa1b-a4bb-4245-ac2a-735c89025100 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.164786 Sep 09 13:15:27.720930 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 53/111] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:27 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:27.798839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c3629d5d-2d8c-4b74-92ef-30f030292bda tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:27.806433 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c3629d5d-2d8c-4b74-92ef-30f030292bda tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.176605 Sep 09 13:15:27.807004 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 59/112] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:27 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:27.858133 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-77a50c55-61ad-40f6-ab58-898691fa5717 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:27.858750 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-77a50c55-61ad-40f6-ab58-898691fa5717 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:27.864969 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77a50c55-61ad-40f6-ab58-898691fa5717 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:27.865456 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77a50c55-61ad-40f6-ab58-898691fa5717 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:27.865898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77a50c55-61ad-40f6-ab58-898691fa5717 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:27.866589 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77a50c55-61ad-40f6-ab58-898691fa5717 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:27.867066 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77a50c55-61ad-40f6-ab58-898691fa5717 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:27.867494 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77a50c55-61ad-40f6-ab58-898691fa5717 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:27.930017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-77a50c55-61ad-40f6-ab58-898691fa5717 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:27.939120 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-77a50c55-61ad-40f6-ab58-898691fa5717 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1298 microversion: 2.1 time: 0.085291 Sep 09 13:15:27.939700 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 54/113] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:27 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:28.032736 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7a9f854b-b51f-4f42-8c74-523aaa27ec6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:28.033411 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7a9f854b-b51f-4f42-8c74-523aaa27ec6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:28.040189 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a9f854b-b51f-4f42-8c74-523aaa27ec6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:28.040648 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a9f854b-b51f-4f42-8c74-523aaa27ec6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:28.041035 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a9f854b-b51f-4f42-8c74-523aaa27ec6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:28.041731 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a9f854b-b51f-4f42-8c74-523aaa27ec6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:28.042329 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a9f854b-b51f-4f42-8c74-523aaa27ec6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:28.042607 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a9f854b-b51f-4f42-8c74-523aaa27ec6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:28.181899 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7a9f854b-b51f-4f42-8c74-523aaa27ec6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:28.190654 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7a9f854b-b51f-4f42-8c74-523aaa27ec6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.162549 Sep 09 13:15:28.191260 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 60/114] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:28 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:28.744068 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0de72696-c4ac-46b4-8a26-461f30364f02 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:28.744810 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0de72696-c4ac-46b4-8a26-461f30364f02 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:28.758085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0de72696-c4ac-46b4-8a26-461f30364f02 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:28.758722 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0de72696-c4ac-46b4-8a26-461f30364f02 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:28.759301 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0de72696-c4ac-46b4-8a26-461f30364f02 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:28.760114 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0de72696-c4ac-46b4-8a26-461f30364f02 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:28.767161 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0de72696-c4ac-46b4-8a26-461f30364f02 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:28.767811 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0de72696-c4ac-46b4-8a26-461f30364f02 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:28.831817 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c6ab5cda-e293-4ffe-9678-014e96d510d4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:28.832429 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c6ab5cda-e293-4ffe-9678-014e96d510d4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:28.838577 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6ab5cda-e293-4ffe-9678-014e96d510d4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:28.839077 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6ab5cda-e293-4ffe-9678-014e96d510d4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:28.839574 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6ab5cda-e293-4ffe-9678-014e96d510d4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:28.840262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6ab5cda-e293-4ffe-9678-014e96d510d4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:28.841535 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6ab5cda-e293-4ffe-9678-014e96d510d4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:28.842140 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6ab5cda-e293-4ffe-9678-014e96d510d4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:29.118493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0de72696-c4ac-46b4-8a26-461f30364f02 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:29.132003 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0de72696-c4ac-46b4-8a26-461f30364f02 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.391609 Sep 09 13:15:29.149816 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 55/115] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:28 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:29.158590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-22f38427-6837-46ef-bcba-c1bc40f545da tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:29.160170 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-22f38427-6837-46ef-bcba-c1bc40f545da tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:29.169106 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22f38427-6837-46ef-bcba-c1bc40f545da tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:29.170378 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22f38427-6837-46ef-bcba-c1bc40f545da tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:29.170979 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22f38427-6837-46ef-bcba-c1bc40f545da tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:29.172020 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22f38427-6837-46ef-bcba-c1bc40f545da tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:29.174479 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22f38427-6837-46ef-bcba-c1bc40f545da tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:29.175527 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22f38427-6837-46ef-bcba-c1bc40f545da tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:29.276319 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-22f38427-6837-46ef-bcba-c1bc40f545da tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:29.306979 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-22f38427-6837-46ef-bcba-c1bc40f545da tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1298 microversion: 2.1 time: 0.152064 Sep 09 13:15:29.311181 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 56/116] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:29 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1298 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:29.321041 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c6ab5cda-e293-4ffe-9678-014e96d510d4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:29.329030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a21a1cca-942b-4345-891e-e60f5d1f9375 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:29.330881 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a21a1cca-942b-4345-891e-e60f5d1f9375 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:29.340260 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c6ab5cda-e293-4ffe-9678-014e96d510d4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.513301 Sep 09 13:15:29.343172 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 61/117] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:28 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:29.356324 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a21a1cca-942b-4345-891e-e60f5d1f9375 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:29.357043 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a21a1cca-942b-4345-891e-e60f5d1f9375 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:29.357544 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a21a1cca-942b-4345-891e-e60f5d1f9375 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:29.358273 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a21a1cca-942b-4345-891e-e60f5d1f9375 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:29.358734 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a21a1cca-942b-4345-891e-e60f5d1f9375 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:29.359201 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a21a1cca-942b-4345-891e-e60f5d1f9375 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:29.795758 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a21a1cca-942b-4345-891e-e60f5d1f9375 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:29.808896 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a21a1cca-942b-4345-891e-e60f5d1f9375 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.495878 Sep 09 13:15:29.809901 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 57/118] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:29 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:30.163321 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9fc44b9c-d632-4e99-b420-2722099508be tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:30.164548 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9fc44b9c-d632-4e99-b420-2722099508be tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:30.171865 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fc44b9c-d632-4e99-b420-2722099508be tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:30.172587 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fc44b9c-d632-4e99-b420-2722099508be tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:30.173113 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fc44b9c-d632-4e99-b420-2722099508be tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:30.173880 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fc44b9c-d632-4e99-b420-2722099508be tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:30.174521 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fc44b9c-d632-4e99-b420-2722099508be tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:30.175014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9fc44b9c-d632-4e99-b420-2722099508be tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:30.336819 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-92bc9b3c-727a-45f8-b5c1-35a1f7c5902e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:30.337777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-92bc9b3c-727a-45f8-b5c1-35a1f7c5902e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:30.346312 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92bc9b3c-727a-45f8-b5c1-35a1f7c5902e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:30.346800 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92bc9b3c-727a-45f8-b5c1-35a1f7c5902e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:30.347433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92bc9b3c-727a-45f8-b5c1-35a1f7c5902e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:30.348286 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92bc9b3c-727a-45f8-b5c1-35a1f7c5902e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:30.348743 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92bc9b3c-727a-45f8-b5c1-35a1f7c5902e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:30.349356 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92bc9b3c-727a-45f8-b5c1-35a1f7c5902e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:30.407867 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9fc44b9c-d632-4e99-b420-2722099508be tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:30.416380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9fc44b9c-d632-4e99-b420-2722099508be tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.257476 Sep 09 13:15:30.428056 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 62/119] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:30 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:30.428056 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2863edf1-946c-434e-8ef8-3048bc8d73bf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:30.428056 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2863edf1-946c-434e-8ef8-3048bc8d73bf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:30.432034 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2863edf1-946c-434e-8ef8-3048bc8d73bf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:30.432448 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2863edf1-946c-434e-8ef8-3048bc8d73bf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:30.432891 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2863edf1-946c-434e-8ef8-3048bc8d73bf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:30.433593 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2863edf1-946c-434e-8ef8-3048bc8d73bf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:30.434137 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2863edf1-946c-434e-8ef8-3048bc8d73bf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:30.434534 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2863edf1-946c-434e-8ef8-3048bc8d73bf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:30.594177 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2863edf1-946c-434e-8ef8-3048bc8d73bf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:30.605394 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2863edf1-946c-434e-8ef8-3048bc8d73bf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.184657 Sep 09 13:15:30.606905 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 63/120] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:30 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:30.655179 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-92bc9b3c-727a-45f8-b5c1-35a1f7c5902e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:30.671311 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-92bc9b3c-727a-45f8-b5c1-35a1f7c5902e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1365 microversion: 2.1 time: 0.330913 Sep 09 13:15:30.671311 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 58/121] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:30 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:30.836990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-293fb158-8dd6-414c-a73e-a41f6c8716e4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:30.837700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-293fb158-8dd6-414c-a73e-a41f6c8716e4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:30.844683 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-293fb158-8dd6-414c-a73e-a41f6c8716e4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:30.845092 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-293fb158-8dd6-414c-a73e-a41f6c8716e4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:30.845740 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-293fb158-8dd6-414c-a73e-a41f6c8716e4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:30.846436 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-293fb158-8dd6-414c-a73e-a41f6c8716e4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:30.847044 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-293fb158-8dd6-414c-a73e-a41f6c8716e4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:30.847495 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-293fb158-8dd6-414c-a73e-a41f6c8716e4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:31.033545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-293fb158-8dd6-414c-a73e-a41f6c8716e4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:31.044447 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-293fb158-8dd6-414c-a73e-a41f6c8716e4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.211966 Sep 09 13:15:31.045642 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 64/122] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:30 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:31.107367 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-bbe26cf1-e5ac-4762-82ba-153fd2c71658 req-e09b482d-47d6-4f56-8803-4c16b94463cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14183836-171b-4a21-ae32-a214060081e8", "tag": "1b06de6b-62d9-4d8f-a0ad-1a6e7bf1b164"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:31.123406 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-bbe26cf1-e5ac-4762-82ba-153fd2c71658 req-e09b482d-47d6-4f56-8803-4c16b94463cf service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:31.123937 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-bbe26cf1-e5ac-4762-82ba-153fd2c71658 req-e09b482d-47d6-4f56-8803-4c16b94463cf service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:31.124430 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-bbe26cf1-e5ac-4762-82ba-153fd2c71658 req-e09b482d-47d6-4f56-8803-4c16b94463cf service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:31.140719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-bbe26cf1-e5ac-4762-82ba-153fd2c71658 req-e09b482d-47d6-4f56-8803-4c16b94463cf service nova] Creating event network-changed:1b06de6b-62d9-4d8f-a0ad-1a6e7bf1b164 for instance 14183836-171b-4a21-ae32-a214060081e8 on hv-cinder-83124 Sep 09 13:15:31.148302 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-bbe26cf1-e5ac-4762-82ba-153fd2c71658 req-e09b482d-47d6-4f56-8803-4c16b94463cf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047268 Sep 09 13:15:31.149651 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 59/123] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:15:31.442472 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5bb16915-fdff-4bcc-a333-808327df60d7 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:31.443249 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5bb16915-fdff-4bcc-a333-808327df60d7 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:31.456276 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb16915-fdff-4bcc-a333-808327df60d7 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:31.456784 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb16915-fdff-4bcc-a333-808327df60d7 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:31.457225 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb16915-fdff-4bcc-a333-808327df60d7 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:31.457967 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb16915-fdff-4bcc-a333-808327df60d7 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:31.458428 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb16915-fdff-4bcc-a333-808327df60d7 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:31.458855 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5bb16915-fdff-4bcc-a333-808327df60d7 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:31.631263 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-601066cd-8b17-44fb-ad38-07c085243100 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:31.632040 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-601066cd-8b17-44fb-ad38-07c085243100 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:31.651379 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-601066cd-8b17-44fb-ad38-07c085243100 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:31.654106 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-601066cd-8b17-44fb-ad38-07c085243100 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:31.657451 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-601066cd-8b17-44fb-ad38-07c085243100 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:31.662672 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-601066cd-8b17-44fb-ad38-07c085243100 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:31.664285 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-601066cd-8b17-44fb-ad38-07c085243100 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:31.664748 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-601066cd-8b17-44fb-ad38-07c085243100 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:31.747797 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5bb16915-fdff-4bcc-a333-808327df60d7 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:31.757923 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5bb16915-fdff-4bcc-a333-808327df60d7 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.320903 Sep 09 13:15:31.759004 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 65/124] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:31 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:31.971840 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-601066cd-8b17-44fb-ad38-07c085243100 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:31.989370 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-601066cd-8b17-44fb-ad38-07c085243100 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.362745 Sep 09 13:15:31.990014 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 60/125] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:31 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:32.015293 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-73ca3ed5-4707-4db0-8ef2-6fd000c064d8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:32.016129 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-73ca3ed5-4707-4db0-8ef2-6fd000c064d8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:32.032629 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0bc8cddf-9f49-4359-a05a-d82709dbe1e9 req-d0bdde06-899b-492a-8286-bc7648f37afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99000808-b419-4f81-b651-d9461adca1d7", "name": "network-vif-plugged", "status": "completed", "tag": "62440413-4def-40fe-bb82-2e853fce3d70"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:32.053264 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73ca3ed5-4707-4db0-8ef2-6fd000c064d8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:32.053760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73ca3ed5-4707-4db0-8ef2-6fd000c064d8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:32.057438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73ca3ed5-4707-4db0-8ef2-6fd000c064d8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:32.058189 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73ca3ed5-4707-4db0-8ef2-6fd000c064d8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:32.071353 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73ca3ed5-4707-4db0-8ef2-6fd000c064d8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:32.071864 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0bc8cddf-9f49-4359-a05a-d82709dbe1e9 req-d0bdde06-899b-492a-8286-bc7648f37afc service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:32.072350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0bc8cddf-9f49-4359-a05a-d82709dbe1e9 req-d0bdde06-899b-492a-8286-bc7648f37afc service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:32.072779 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0bc8cddf-9f49-4359-a05a-d82709dbe1e9 req-d0bdde06-899b-492a-8286-bc7648f37afc service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:32.073162 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73ca3ed5-4707-4db0-8ef2-6fd000c064d8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:32.088311 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0bc8cddf-9f49-4359-a05a-d82709dbe1e9 req-d0bdde06-899b-492a-8286-bc7648f37afc service nova] Creating event network-vif-plugged:62440413-4def-40fe-bb82-2e853fce3d70 for instance 99000808-b419-4f81-b651-d9461adca1d7 on hv-cinder-83124 Sep 09 13:15:32.095532 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0bc8cddf-9f49-4359-a05a-d82709dbe1e9 req-d0bdde06-899b-492a-8286-bc7648f37afc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.334140 Sep 09 13:15:32.096920 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 66/126] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:15:32.105029 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ced0a3a4-4e9c-4c9a-b295-3a5f6c5c1de2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:32.105903 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ced0a3a4-4e9c-4c9a-b295-3a5f6c5c1de2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:32.120033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ced0a3a4-4e9c-4c9a-b295-3a5f6c5c1de2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:32.120613 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ced0a3a4-4e9c-4c9a-b295-3a5f6c5c1de2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:32.121123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ced0a3a4-4e9c-4c9a-b295-3a5f6c5c1de2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:32.121979 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ced0a3a4-4e9c-4c9a-b295-3a5f6c5c1de2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:32.122507 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ced0a3a4-4e9c-4c9a-b295-3a5f6c5c1de2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:32.123003 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ced0a3a4-4e9c-4c9a-b295-3a5f6c5c1de2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:32.270987 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-73ca3ed5-4707-4db0-8ef2-6fd000c064d8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:32.281466 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-73ca3ed5-4707-4db0-8ef2-6fd000c064d8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1365 microversion: 2.1 time: 0.290006 Sep 09 13:15:32.282048 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 61/127] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:31 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:32.305525 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ced0a3a4-4e9c-4c9a-b295-3a5f6c5c1de2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:32.313253 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ced0a3a4-4e9c-4c9a-b295-3a5f6c5c1de2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.214875 Sep 09 13:15:32.313819 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 67/128] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:32 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:32.785358 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6242c590-e3c0-4dd5-b6a5-de82c51e7a42 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:32.785875 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6242c590-e3c0-4dd5-b6a5-de82c51e7a42 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:32.792128 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6242c590-e3c0-4dd5-b6a5-de82c51e7a42 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:32.792608 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6242c590-e3c0-4dd5-b6a5-de82c51e7a42 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:32.793031 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6242c590-e3c0-4dd5-b6a5-de82c51e7a42 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:32.794894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6242c590-e3c0-4dd5-b6a5-de82c51e7a42 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:32.795374 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6242c590-e3c0-4dd5-b6a5-de82c51e7a42 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:32.796139 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6242c590-e3c0-4dd5-b6a5-de82c51e7a42 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:32.968734 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6242c590-e3c0-4dd5-b6a5-de82c51e7a42 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:32.977349 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6242c590-e3c0-4dd5-b6a5-de82c51e7a42 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.196399 Sep 09 13:15:32.987090 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 62/129] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:32 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:33.018619 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78659a16-ac3d-435b-a3d2-5c9cb0f0a727 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:33.019816 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-78659a16-ac3d-435b-a3d2-5c9cb0f0a727 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:33.026441 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78659a16-ac3d-435b-a3d2-5c9cb0f0a727 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:33.027725 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78659a16-ac3d-435b-a3d2-5c9cb0f0a727 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:33.028900 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78659a16-ac3d-435b-a3d2-5c9cb0f0a727 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:33.029803 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78659a16-ac3d-435b-a3d2-5c9cb0f0a727 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:33.030361 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78659a16-ac3d-435b-a3d2-5c9cb0f0a727 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:33.030892 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78659a16-ac3d-435b-a3d2-5c9cb0f0a727 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:33.052149 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:33.195017 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-78659a16-ac3d-435b-a3d2-5c9cb0f0a727 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:33.204031 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-78659a16-ac3d-435b-a3d2-5c9cb0f0a727 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.189571 Sep 09 13:15:33.204623 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 68/130] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:33 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:33.311912 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5ed0569d-6bc6-4996-a952-24b2c462d10c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:33.312524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5ed0569d-6bc6-4996-a952-24b2c462d10c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:33.319246 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ed0569d-6bc6-4996-a952-24b2c462d10c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:33.319982 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ed0569d-6bc6-4996-a952-24b2c462d10c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:33.320566 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ed0569d-6bc6-4996-a952-24b2c462d10c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:33.321412 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ed0569d-6bc6-4996-a952-24b2c462d10c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:33.322012 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ed0569d-6bc6-4996-a952-24b2c462d10c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:33.322594 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ed0569d-6bc6-4996-a952-24b2c462d10c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:33.338007 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8340b823-aedc-4291-9b88-2e832f6e7b91 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:33.338960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8340b823-aedc-4291-9b88-2e832f6e7b91 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:33.349470 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8340b823-aedc-4291-9b88-2e832f6e7b91 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:33.349960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8340b823-aedc-4291-9b88-2e832f6e7b91 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:33.353391 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8340b823-aedc-4291-9b88-2e832f6e7b91 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:33.354432 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8340b823-aedc-4291-9b88-2e832f6e7b91 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:33.357041 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8340b823-aedc-4291-9b88-2e832f6e7b91 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:33.361071 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8340b823-aedc-4291-9b88-2e832f6e7b91 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:33.591728 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8340b823-aedc-4291-9b88-2e832f6e7b91 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:33.596676 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5ed0569d-6bc6-4996-a952-24b2c462d10c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:33.601469 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8340b823-aedc-4291-9b88-2e832f6e7b91 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.267346 Sep 09 13:15:33.602850 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 69/131] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:33 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:33.608146 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5ed0569d-6bc6-4996-a952-24b2c462d10c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1365 microversion: 2.1 time: 0.300586 Sep 09 13:15:33.612810 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 63/132] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:33 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:34.006157 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d28b7c44-16fa-4a17-b88f-dada6403e937 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:34.006907 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d28b7c44-16fa-4a17-b88f-dada6403e937 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:34.015089 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d28b7c44-16fa-4a17-b88f-dada6403e937 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:34.015806 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d28b7c44-16fa-4a17-b88f-dada6403e937 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:34.016296 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d28b7c44-16fa-4a17-b88f-dada6403e937 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:34.017111 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d28b7c44-16fa-4a17-b88f-dada6403e937 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:34.017620 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d28b7c44-16fa-4a17-b88f-dada6403e937 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:34.018098 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d28b7c44-16fa-4a17-b88f-dada6403e937 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:34.111021 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-93c51564-7246-4a6c-b154-e682505cec1f req-65de0118-65f2-4efd-951e-4587eac14b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f12266-677e-473d-8fbd-bf3136398e58", "name": "network-vif-plugged", "status": "completed", "tag": "d0f7b8a7-7f54-44ba-988c-5391e6311e17"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:34.120577 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-93c51564-7246-4a6c-b154-e682505cec1f req-65de0118-65f2-4efd-951e-4587eac14b73 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:34.121060 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-93c51564-7246-4a6c-b154-e682505cec1f req-65de0118-65f2-4efd-951e-4587eac14b73 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:34.121491 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-93c51564-7246-4a6c-b154-e682505cec1f req-65de0118-65f2-4efd-951e-4587eac14b73 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:34.132675 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-93c51564-7246-4a6c-b154-e682505cec1f req-65de0118-65f2-4efd-951e-4587eac14b73 service nova] Creating event network-vif-plugged:d0f7b8a7-7f54-44ba-988c-5391e6311e17 for instance d7f12266-677e-473d-8fbd-bf3136398e58 on hv-cinder-83124 Sep 09 13:15:34.140046 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-93c51564-7246-4a6c-b154-e682505cec1f req-65de0118-65f2-4efd-951e-4587eac14b73 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032988 Sep 09 13:15:34.140655 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 64/133] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:15:34.203213 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d28b7c44-16fa-4a17-b88f-dada6403e937 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:34.212911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d28b7c44-16fa-4a17-b88f-dada6403e937 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.210893 Sep 09 13:15:34.213762 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 70/134] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:34 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:34.235666 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-03adb100-f058-4a1b-a568-da75761261e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:34.236369 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-03adb100-f058-4a1b-a568-da75761261e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:34.247447 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03adb100-f058-4a1b-a568-da75761261e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:34.248307 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03adb100-f058-4a1b-a568-da75761261e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:34.249485 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03adb100-f058-4a1b-a568-da75761261e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:34.250511 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03adb100-f058-4a1b-a568-da75761261e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:34.251022 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03adb100-f058-4a1b-a568-da75761261e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:34.251601 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03adb100-f058-4a1b-a568-da75761261e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:34.388510 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-03adb100-f058-4a1b-a568-da75761261e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:34.396571 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-03adb100-f058-4a1b-a568-da75761261e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.165520 Sep 09 13:15:34.397148 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 65/135] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:34 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:34.628563 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f20ae1ce-b2da-4452-9e68-44cbb87e862f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:34.629420 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f20ae1ce-b2da-4452-9e68-44cbb87e862f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:34.636944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-75fc1f0d-881d-4855-a1f7-b417a28e08b3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:34.637125 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f20ae1ce-b2da-4452-9e68-44cbb87e862f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:34.637507 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f20ae1ce-b2da-4452-9e68-44cbb87e862f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:34.637723 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-75fc1f0d-881d-4855-a1f7-b417a28e08b3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:34.637938 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f20ae1ce-b2da-4452-9e68-44cbb87e862f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:34.640696 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:34.642334 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f20ae1ce-b2da-4452-9e68-44cbb87e862f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:34.643076 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f20ae1ce-b2da-4452-9e68-44cbb87e862f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:34.645913 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f20ae1ce-b2da-4452-9e68-44cbb87e862f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:34.647821 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-75fc1f0d-881d-4855-a1f7-b417a28e08b3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:34.648588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-75fc1f0d-881d-4855-a1f7-b417a28e08b3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:34.649249 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-75fc1f0d-881d-4855-a1f7-b417a28e08b3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:34.650162 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-75fc1f0d-881d-4855-a1f7-b417a28e08b3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:34.650830 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-75fc1f0d-881d-4855-a1f7-b417a28e08b3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:34.651491 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-75fc1f0d-881d-4855-a1f7-b417a28e08b3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:34.818970 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-75fc1f0d-881d-4855-a1f7-b417a28e08b3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:34.827738 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-75fc1f0d-881d-4855-a1f7-b417a28e08b3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1365 microversion: 2.1 time: 0.195290 Sep 09 13:15:34.828318 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 66/136] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:34 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:34.917313 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f20ae1ce-b2da-4452-9e68-44cbb87e862f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:34.927542 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f20ae1ce-b2da-4452-9e68-44cbb87e862f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.302820 Sep 09 13:15:34.937977 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 71/137] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:34 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:35.236849 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2c115f31-b7ae-410c-bee1-9c091eacb61f tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:35.237412 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2c115f31-b7ae-410c-bee1-9c091eacb61f tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:35.248635 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c115f31-b7ae-410c-bee1-9c091eacb61f tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:35.248635 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c115f31-b7ae-410c-bee1-9c091eacb61f tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:35.249081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c115f31-b7ae-410c-bee1-9c091eacb61f tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:35.249775 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c115f31-b7ae-410c-bee1-9c091eacb61f tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:35.250315 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c115f31-b7ae-410c-bee1-9c091eacb61f tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:35.250728 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c115f31-b7ae-410c-bee1-9c091eacb61f tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:35.389401 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2c115f31-b7ae-410c-bee1-9c091eacb61f tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:35.391635 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:35.398000 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2c115f31-b7ae-410c-bee1-9c091eacb61f tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.165025 Sep 09 13:15:35.398576 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 67/138] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:35 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:35.421549 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b4d8d39f-8dec-44fb-8222-d961234c95c5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:35.422152 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b4d8d39f-8dec-44fb-8222-d961234c95c5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:35.428191 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4d8d39f-8dec-44fb-8222-d961234c95c5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:35.428666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4d8d39f-8dec-44fb-8222-d961234c95c5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:35.429090 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4d8d39f-8dec-44fb-8222-d961234c95c5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:35.429770 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4d8d39f-8dec-44fb-8222-d961234c95c5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:35.430210 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4d8d39f-8dec-44fb-8222-d961234c95c5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:35.430801 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4d8d39f-8dec-44fb-8222-d961234c95c5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:35.569131 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b4d8d39f-8dec-44fb-8222-d961234c95c5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:35.577759 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b4d8d39f-8dec-44fb-8222-d961234c95c5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.160218 Sep 09 13:15:35.578328 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 72/139] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:35 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:35.851008 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fe46cf27-4030-444e-b288-c8039d99174c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:35.851644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fe46cf27-4030-444e-b288-c8039d99174c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:35.858128 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe46cf27-4030-444e-b288-c8039d99174c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:35.858612 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe46cf27-4030-444e-b288-c8039d99174c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:35.859044 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe46cf27-4030-444e-b288-c8039d99174c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:35.859760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe46cf27-4030-444e-b288-c8039d99174c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:35.860207 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe46cf27-4030-444e-b288-c8039d99174c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:35.860630 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe46cf27-4030-444e-b288-c8039d99174c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:35.954055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-391141f2-d815-4f37-b11a-31c2ad388ae8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:35.954909 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-391141f2-d815-4f37-b11a-31c2ad388ae8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:35.961882 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-391141f2-d815-4f37-b11a-31c2ad388ae8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:35.962750 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-391141f2-d815-4f37-b11a-31c2ad388ae8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:35.963469 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-391141f2-d815-4f37-b11a-31c2ad388ae8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:35.964154 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-391141f2-d815-4f37-b11a-31c2ad388ae8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:35.964744 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-391141f2-d815-4f37-b11a-31c2ad388ae8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:35.966092 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-391141f2-d815-4f37-b11a-31c2ad388ae8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:36.001137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fe46cf27-4030-444e-b288-c8039d99174c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:36.009036 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fe46cf27-4030-444e-b288-c8039d99174c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1365 microversion: 2.1 time: 0.161811 Sep 09 13:15:36.009592 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 68/140] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:35 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:36.124074 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-391141f2-d815-4f37-b11a-31c2ad388ae8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:36.133905 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-391141f2-d815-4f37-b11a-31c2ad388ae8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.184064 Sep 09 13:15:36.134468 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 73/141] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:35 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:36.421294 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1faa8682-faab-42e1-8f26-8f4e3b1cc7c0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:36.421948 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1faa8682-faab-42e1-8f26-8f4e3b1cc7c0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:36.428148 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1faa8682-faab-42e1-8f26-8f4e3b1cc7c0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:36.428645 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1faa8682-faab-42e1-8f26-8f4e3b1cc7c0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:36.429082 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1faa8682-faab-42e1-8f26-8f4e3b1cc7c0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:36.429785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1faa8682-faab-42e1-8f26-8f4e3b1cc7c0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:36.430243 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1faa8682-faab-42e1-8f26-8f4e3b1cc7c0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:36.430674 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1faa8682-faab-42e1-8f26-8f4e3b1cc7c0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:36.562936 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1faa8682-faab-42e1-8f26-8f4e3b1cc7c0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:36.570793 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1faa8682-faab-42e1-8f26-8f4e3b1cc7c0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.154355 Sep 09 13:15:36.571377 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 69/142] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:36 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:36.600125 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cb97918e-5768-4c8e-8bf0-23c3237e6011 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:36.601540 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cb97918e-5768-4c8e-8bf0-23c3237e6011 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:36.609065 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb97918e-5768-4c8e-8bf0-23c3237e6011 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:36.609690 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb97918e-5768-4c8e-8bf0-23c3237e6011 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:36.610379 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb97918e-5768-4c8e-8bf0-23c3237e6011 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:36.611328 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb97918e-5768-4c8e-8bf0-23c3237e6011 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:36.611739 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb97918e-5768-4c8e-8bf0-23c3237e6011 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:36.612166 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cb97918e-5768-4c8e-8bf0-23c3237e6011 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:36.755391 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cb97918e-5768-4c8e-8bf0-23c3237e6011 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:36.763368 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cb97918e-5768-4c8e-8bf0-23c3237e6011 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.167210 Sep 09 13:15:36.763940 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 74/143] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:36 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:37.034210 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d7ef5ef2-9872-4f11-855d-d2f7464e67a6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:37.034828 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d7ef5ef2-9872-4f11-855d-d2f7464e67a6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:37.043209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d7ef5ef2-9872-4f11-855d-d2f7464e67a6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:37.043811 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d7ef5ef2-9872-4f11-855d-d2f7464e67a6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:37.044246 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d7ef5ef2-9872-4f11-855d-d2f7464e67a6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:37.045036 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d7ef5ef2-9872-4f11-855d-d2f7464e67a6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:37.045498 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d7ef5ef2-9872-4f11-855d-d2f7464e67a6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:37.046426 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d7ef5ef2-9872-4f11-855d-d2f7464e67a6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:37.160284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e8ebfce2-51d9-4aa9-b2e0-dccf01a115d8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:37.165381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e8ebfce2-51d9-4aa9-b2e0-dccf01a115d8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:37.175359 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8ebfce2-51d9-4aa9-b2e0-dccf01a115d8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:37.175852 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8ebfce2-51d9-4aa9-b2e0-dccf01a115d8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:37.184842 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8ebfce2-51d9-4aa9-b2e0-dccf01a115d8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:37.186004 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8ebfce2-51d9-4aa9-b2e0-dccf01a115d8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:37.186562 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8ebfce2-51d9-4aa9-b2e0-dccf01a115d8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:37.187146 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e8ebfce2-51d9-4aa9-b2e0-dccf01a115d8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:37.187634 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d7ef5ef2-9872-4f11-855d-d2f7464e67a6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:37.195553 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d7ef5ef2-9872-4f11-855d-d2f7464e67a6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1365 microversion: 2.1 time: 0.165709 Sep 09 13:15:37.201592 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 70/144] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:37 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:37.408582 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e8ebfce2-51d9-4aa9-b2e0-dccf01a115d8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:37.418992 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e8ebfce2-51d9-4aa9-b2e0-dccf01a115d8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.265583 Sep 09 13:15:37.419602 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 75/145] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:37 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:37.616114 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b3067b64-2c58-4a0d-9ef8-604aa1ebf00e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:37.616831 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b3067b64-2c58-4a0d-9ef8-604aa1ebf00e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:37.629438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3067b64-2c58-4a0d-9ef8-604aa1ebf00e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:37.630871 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3067b64-2c58-4a0d-9ef8-604aa1ebf00e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:37.631763 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3067b64-2c58-4a0d-9ef8-604aa1ebf00e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:37.632796 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3067b64-2c58-4a0d-9ef8-604aa1ebf00e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:37.633404 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3067b64-2c58-4a0d-9ef8-604aa1ebf00e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:37.634176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3067b64-2c58-4a0d-9ef8-604aa1ebf00e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:37.788681 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4af67b03-24bb-4bae-8d9d-baee87d3aad2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:37.790031 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4af67b03-24bb-4bae-8d9d-baee87d3aad2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:37.799631 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4af67b03-24bb-4bae-8d9d-baee87d3aad2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:37.800370 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4af67b03-24bb-4bae-8d9d-baee87d3aad2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:37.801212 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4af67b03-24bb-4bae-8d9d-baee87d3aad2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:37.802135 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4af67b03-24bb-4bae-8d9d-baee87d3aad2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:37.803037 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4af67b03-24bb-4bae-8d9d-baee87d3aad2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:37.803996 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4af67b03-24bb-4bae-8d9d-baee87d3aad2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:38.094685 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4af67b03-24bb-4bae-8d9d-baee87d3aad2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:38.111442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4af67b03-24bb-4bae-8d9d-baee87d3aad2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.327915 Sep 09 13:15:38.116493 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 76/146] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:37 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:38.227091 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cc7be1f3-c8ab-4bc3-9097-576ca51ba5ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:38.228326 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc7be1f3-c8ab-4bc3-9097-576ca51ba5ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:38.238238 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc7be1f3-c8ab-4bc3-9097-576ca51ba5ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:38.238964 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc7be1f3-c8ab-4bc3-9097-576ca51ba5ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:38.239747 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc7be1f3-c8ab-4bc3-9097-576ca51ba5ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:38.248632 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b3067b64-2c58-4a0d-9ef8-604aa1ebf00e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:38.261088 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc7be1f3-c8ab-4bc3-9097-576ca51ba5ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:38.261358 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b3067b64-2c58-4a0d-9ef8-604aa1ebf00e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.663386 Sep 09 13:15:38.263234 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 71/147] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:37 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:38.273749 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc7be1f3-c8ab-4bc3-9097-576ca51ba5ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:38.275939 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc7be1f3-c8ab-4bc3-9097-576ca51ba5ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:38.444843 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-85fb3856-0dd1-4cb6-b534-87dc67fb82e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:38.446125 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-85fb3856-0dd1-4cb6-b534-87dc67fb82e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:38.453968 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-85fb3856-0dd1-4cb6-b534-87dc67fb82e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:38.454876 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-85fb3856-0dd1-4cb6-b534-87dc67fb82e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:38.455539 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-85fb3856-0dd1-4cb6-b534-87dc67fb82e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:38.456574 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-85fb3856-0dd1-4cb6-b534-87dc67fb82e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:38.457210 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-85fb3856-0dd1-4cb6-b534-87dc67fb82e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:38.457814 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-85fb3856-0dd1-4cb6-b534-87dc67fb82e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:38.543099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cc7be1f3-c8ab-4bc3-9097-576ca51ba5ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:38.556898 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cc7be1f3-c8ab-4bc3-9097-576ca51ba5ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1365 microversion: 2.1 time: 0.335541 Sep 09 13:15:38.576145 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 77/148] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:38 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1365 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:38.776384 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-85fb3856-0dd1-4cb6-b534-87dc67fb82e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:38.787950 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-85fb3856-0dd1-4cb6-b534-87dc67fb82e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.348981 Sep 09 13:15:38.804894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 72/149] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:38 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:39.149283 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3d4227a4-7017-4544-bbf8-9474da8a655f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:39.150644 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3d4227a4-7017-4544-bbf8-9474da8a655f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:39.156689 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d4227a4-7017-4544-bbf8-9474da8a655f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:39.157252 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d4227a4-7017-4544-bbf8-9474da8a655f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:39.157682 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d4227a4-7017-4544-bbf8-9474da8a655f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:39.158522 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d4227a4-7017-4544-bbf8-9474da8a655f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:39.159218 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d4227a4-7017-4544-bbf8-9474da8a655f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:39.159728 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3d4227a4-7017-4544-bbf8-9474da8a655f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:39.285549 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5594afa4-5517-4bf6-8688-b721f8091e73 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:39.286357 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5594afa4-5517-4bf6-8688-b721f8091e73 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:39.303595 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5594afa4-5517-4bf6-8688-b721f8091e73 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:39.304784 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5594afa4-5517-4bf6-8688-b721f8091e73 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:39.313866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5594afa4-5517-4bf6-8688-b721f8091e73 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:39.314624 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5594afa4-5517-4bf6-8688-b721f8091e73 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:39.315125 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5594afa4-5517-4bf6-8688-b721f8091e73 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:39.315560 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5594afa4-5517-4bf6-8688-b721f8091e73 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:39.338449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3d4227a4-7017-4544-bbf8-9474da8a655f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:39.346397 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3d4227a4-7017-4544-bbf8-9474da8a655f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.204210 Sep 09 13:15:39.347320 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 78/150] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:39 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:39.511905 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5594afa4-5517-4bf6-8688-b721f8091e73 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:39.519888 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5594afa4-5517-4bf6-8688-b721f8091e73 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.238202 Sep 09 13:15:39.520693 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 73/151] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:39 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:39.547805 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-2a1d295f-68b1-48a6-b821-05585e7aab8b req-703debce-8c38-4404-9bb0-20f25d9cac22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9110cf-907a-46bc-8e9d-31dd3c409e39", "name": "network-vif-plugged", "status": "completed", "tag": "bcff1243-0152-492c-9c36-aa3e840243d3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:39.552705 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:39.559095 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2a1d295f-68b1-48a6-b821-05585e7aab8b req-703debce-8c38-4404-9bb0-20f25d9cac22 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:39.559862 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2a1d295f-68b1-48a6-b821-05585e7aab8b req-703debce-8c38-4404-9bb0-20f25d9cac22 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:39.560284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2a1d295f-68b1-48a6-b821-05585e7aab8b req-703debce-8c38-4404-9bb0-20f25d9cac22 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:39.576866 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-2a1d295f-68b1-48a6-b821-05585e7aab8b req-703debce-8c38-4404-9bb0-20f25d9cac22 service nova] Creating event network-vif-plugged:bcff1243-0152-492c-9c36-aa3e840243d3 for instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 on hv-cinder-83124 Sep 09 13:15:39.586889 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-219ee507-6125-48c1-a59f-c6fe69821d83 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:39.587784 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-219ee507-6125-48c1-a59f-c6fe69821d83 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:39.587914 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-2a1d295f-68b1-48a6-b821-05585e7aab8b req-703debce-8c38-4404-9bb0-20f25d9cac22 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043902 Sep 09 13:15:39.589082 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 79/152] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:15:39.596559 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-219ee507-6125-48c1-a59f-c6fe69821d83 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:39.598054 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-219ee507-6125-48c1-a59f-c6fe69821d83 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:39.598636 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-219ee507-6125-48c1-a59f-c6fe69821d83 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:39.599567 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-219ee507-6125-48c1-a59f-c6fe69821d83 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:39.600082 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-219ee507-6125-48c1-a59f-c6fe69821d83 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:39.600579 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-219ee507-6125-48c1-a59f-c6fe69821d83 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:39.768433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-219ee507-6125-48c1-a59f-c6fe69821d83 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:39.777650 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-219ee507-6125-48c1-a59f-c6fe69821d83 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1365 microversion: 2.1 time: 0.195777 Sep 09 13:15:39.785610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 74/153] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:39 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:39.832268 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8be16206-f608-4a88-bcdd-63669b664b1b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:39.835025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8be16206-f608-4a88-bcdd-63669b664b1b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:39.845107 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8be16206-f608-4a88-bcdd-63669b664b1b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:39.845841 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8be16206-f608-4a88-bcdd-63669b664b1b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:39.846517 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8be16206-f608-4a88-bcdd-63669b664b1b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:39.847482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8be16206-f608-4a88-bcdd-63669b664b1b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:39.848142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8be16206-f608-4a88-bcdd-63669b664b1b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:39.848753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8be16206-f608-4a88-bcdd-63669b664b1b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:40.250956 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8be16206-f608-4a88-bcdd-63669b664b1b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:40.261204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8be16206-f608-4a88-bcdd-63669b664b1b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.436359 Sep 09 13:15:40.264342 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 80/154] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:39 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:40.374390 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-56f43eba-cdff-4c4c-be07-6a043856d4a2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:40.375268 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-56f43eba-cdff-4c4c-be07-6a043856d4a2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:40.384634 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f43eba-cdff-4c4c-be07-6a043856d4a2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:40.385905 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f43eba-cdff-4c4c-be07-6a043856d4a2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:40.386855 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f43eba-cdff-4c4c-be07-6a043856d4a2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:40.387868 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f43eba-cdff-4c4c-be07-6a043856d4a2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:40.389160 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f43eba-cdff-4c4c-be07-6a043856d4a2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:40.389732 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56f43eba-cdff-4c4c-be07-6a043856d4a2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:40.546506 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3a53abad-9418-4cfd-a1f0-86bbff546007 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:40.547469 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3a53abad-9418-4cfd-a1f0-86bbff546007 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:40.565031 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a53abad-9418-4cfd-a1f0-86bbff546007 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:40.566221 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a53abad-9418-4cfd-a1f0-86bbff546007 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:40.566659 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a53abad-9418-4cfd-a1f0-86bbff546007 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:40.571041 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a53abad-9418-4cfd-a1f0-86bbff546007 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:40.591531 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a53abad-9418-4cfd-a1f0-86bbff546007 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:40.592598 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a53abad-9418-4cfd-a1f0-86bbff546007 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:40.666979 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-56f43eba-cdff-4c4c-be07-6a043856d4a2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:40.678078 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-56f43eba-cdff-4c4c-be07-6a043856d4a2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.309392 Sep 09 13:15:40.678874 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 75/155] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:40 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:40.808549 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c340c046-a2a3-4ed6-b33a-82441923c777 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:40.810765 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3a53abad-9418-4cfd-a1f0-86bbff546007 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:40.814076 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c340c046-a2a3-4ed6-b33a-82441923c777 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:40.828878 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3a53abad-9418-4cfd-a1f0-86bbff546007 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.287336 Sep 09 13:15:40.829469 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 81/156] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:40 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:40.836821 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c340c046-a2a3-4ed6-b33a-82441923c777 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:40.837313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c340c046-a2a3-4ed6-b33a-82441923c777 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:40.837744 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c340c046-a2a3-4ed6-b33a-82441923c777 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:40.838436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c340c046-a2a3-4ed6-b33a-82441923c777 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:40.838888 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c340c046-a2a3-4ed6-b33a-82441923c777 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:40.839330 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c340c046-a2a3-4ed6-b33a-82441923c777 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:41.035083 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c340c046-a2a3-4ed6-b33a-82441923c777 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:41.047561 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c340c046-a2a3-4ed6-b33a-82441923c777 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1365 microversion: 2.1 time: 0.242202 Sep 09 13:15:41.048748 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 76/157] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:40 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:41.288930 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-52993004-e590-46e5-a202-ec1a9a98a822 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:41.290126 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-52993004-e590-46e5-a202-ec1a9a98a822 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:41.299383 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52993004-e590-46e5-a202-ec1a9a98a822 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:41.300044 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52993004-e590-46e5-a202-ec1a9a98a822 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:41.300711 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52993004-e590-46e5-a202-ec1a9a98a822 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:41.301634 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52993004-e590-46e5-a202-ec1a9a98a822 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:41.302305 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52993004-e590-46e5-a202-ec1a9a98a822 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:41.302861 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-52993004-e590-46e5-a202-ec1a9a98a822 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:41.463155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-52993004-e590-46e5-a202-ec1a9a98a822 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:41.471669 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-52993004-e590-46e5-a202-ec1a9a98a822 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.188008 Sep 09 13:15:41.472517 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 82/158] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:41 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:41.610954 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-4054cbb9-eb4b-4f78-8957-d559a4408dc1 req-20d93522-f4f5-43de-a3d2-7ea62dc63e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1258804f-2f19-4ed2-94c2-0d75ea5360e5", "name": "network-vif-plugged", "status": "completed", "tag": "6111168d-48bc-4721-b702-cd5679acabff"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:41.621257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-4054cbb9-eb4b-4f78-8957-d559a4408dc1 req-20d93522-f4f5-43de-a3d2-7ea62dc63e8d service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:41.622139 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-4054cbb9-eb4b-4f78-8957-d559a4408dc1 req-20d93522-f4f5-43de-a3d2-7ea62dc63e8d service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:41.622688 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-4054cbb9-eb4b-4f78-8957-d559a4408dc1 req-20d93522-f4f5-43de-a3d2-7ea62dc63e8d service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:41.634294 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-4054cbb9-eb4b-4f78-8957-d559a4408dc1 req-20d93522-f4f5-43de-a3d2-7ea62dc63e8d service nova] Creating event network-vif-plugged:6111168d-48bc-4721-b702-cd5679acabff for instance 1258804f-2f19-4ed2-94c2-0d75ea5360e5 on hv-cinder-83124 Sep 09 13:15:41.640157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-4054cbb9-eb4b-4f78-8957-d559a4408dc1 req-20d93522-f4f5-43de-a3d2-7ea62dc63e8d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032851 Sep 09 13:15:41.640737 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 77/159] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:15:41.703187 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ca09754e-b5ea-4cfe-bec6-19e67ed7c606 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:41.703911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ca09754e-b5ea-4cfe-bec6-19e67ed7c606 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:41.710020 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca09754e-b5ea-4cfe-bec6-19e67ed7c606 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:41.710686 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca09754e-b5ea-4cfe-bec6-19e67ed7c606 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:41.711136 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca09754e-b5ea-4cfe-bec6-19e67ed7c606 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:41.712015 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca09754e-b5ea-4cfe-bec6-19e67ed7c606 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:41.712450 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca09754e-b5ea-4cfe-bec6-19e67ed7c606 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:41.712894 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca09754e-b5ea-4cfe-bec6-19e67ed7c606 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:41.853003 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-11f2fc64-db68-4b1e-93fd-0f62e14b2b5c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:41.853826 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-11f2fc64-db68-4b1e-93fd-0f62e14b2b5c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:41.860911 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11f2fc64-db68-4b1e-93fd-0f62e14b2b5c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:41.861489 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11f2fc64-db68-4b1e-93fd-0f62e14b2b5c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:41.861992 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11f2fc64-db68-4b1e-93fd-0f62e14b2b5c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:41.863005 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11f2fc64-db68-4b1e-93fd-0f62e14b2b5c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:41.863486 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11f2fc64-db68-4b1e-93fd-0f62e14b2b5c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:41.863911 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11f2fc64-db68-4b1e-93fd-0f62e14b2b5c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:41.923553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ca09754e-b5ea-4cfe-bec6-19e67ed7c606 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:41.932323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ca09754e-b5ea-4cfe-bec6-19e67ed7c606 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.233521 Sep 09 13:15:41.941777 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 83/160] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:41 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:41.998811 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-11f2fc64-db68-4b1e-93fd-0f62e14b2b5c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:42.007172 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-11f2fc64-db68-4b1e-93fd-0f62e14b2b5c tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.158222 Sep 09 13:15:42.007749 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 78/161] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:41 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:42.076043 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0a7868ec-8695-4559-a176-71a595a77402 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:42.076941 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0a7868ec-8695-4559-a176-71a595a77402 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:42.083643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a7868ec-8695-4559-a176-71a595a77402 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:42.084393 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a7868ec-8695-4559-a176-71a595a77402 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:42.084843 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a7868ec-8695-4559-a176-71a595a77402 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:42.085534 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a7868ec-8695-4559-a176-71a595a77402 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:42.085984 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a7868ec-8695-4559-a176-71a595a77402 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:42.086404 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0a7868ec-8695-4559-a176-71a595a77402 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:42.217809 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0a7868ec-8695-4559-a176-71a595a77402 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:42.225958 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0a7868ec-8695-4559-a176-71a595a77402 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1365 microversion: 2.1 time: 0.154845 Sep 09 13:15:42.226521 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 84/162] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:42 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:42.496541 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c398e13f-5acf-4390-82ce-125fe2b0dd50 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:42.497432 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c398e13f-5acf-4390-82ce-125fe2b0dd50 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:42.503388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c398e13f-5acf-4390-82ce-125fe2b0dd50 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:42.503941 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c398e13f-5acf-4390-82ce-125fe2b0dd50 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:42.504293 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c398e13f-5acf-4390-82ce-125fe2b0dd50 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:42.504981 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c398e13f-5acf-4390-82ce-125fe2b0dd50 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:42.505430 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c398e13f-5acf-4390-82ce-125fe2b0dd50 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:42.505850 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c398e13f-5acf-4390-82ce-125fe2b0dd50 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:42.652349 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c398e13f-5acf-4390-82ce-125fe2b0dd50 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:42.661904 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c398e13f-5acf-4390-82ce-125fe2b0dd50 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.169066 Sep 09 13:15:42.662482 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 79/163] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:42 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:42.954605 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c23784cb-0e64-4bb7-9699-df1feb6462cc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:42.955251 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c23784cb-0e64-4bb7-9699-df1feb6462cc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:42.961158 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c23784cb-0e64-4bb7-9699-df1feb6462cc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:42.961703 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c23784cb-0e64-4bb7-9699-df1feb6462cc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:42.962046 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c23784cb-0e64-4bb7-9699-df1feb6462cc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:42.962733 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c23784cb-0e64-4bb7-9699-df1feb6462cc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:42.963218 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c23784cb-0e64-4bb7-9699-df1feb6462cc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:42.963756 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c23784cb-0e64-4bb7-9699-df1feb6462cc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:43.030008 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c31d2ea7-898b-4ac7-8831-208503beb05b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:43.030957 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c31d2ea7-898b-4ac7-8831-208503beb05b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:43.037710 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c31d2ea7-898b-4ac7-8831-208503beb05b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:43.038216 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c31d2ea7-898b-4ac7-8831-208503beb05b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:43.038691 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c31d2ea7-898b-4ac7-8831-208503beb05b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:43.039589 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c31d2ea7-898b-4ac7-8831-208503beb05b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:43.040044 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c31d2ea7-898b-4ac7-8831-208503beb05b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:43.040507 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c31d2ea7-898b-4ac7-8831-208503beb05b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:43.117975 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c23784cb-0e64-4bb7-9699-df1feb6462cc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:43.123262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:43.130782 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c23784cb-0e64-4bb7-9699-df1feb6462cc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1363 microversion: 2.1 time: 0.179928 Sep 09 13:15:43.135163 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 85/164] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:42 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:43.192069 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c31d2ea7-898b-4ac7-8831-208503beb05b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:43.200384 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c31d2ea7-898b-4ac7-8831-208503beb05b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1314 microversion: 2.1 time: 0.173722 Sep 09 13:15:43.201062 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 80/165] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:43 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:43.248974 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42b6ef99-5162-4dbc-99ec-73a29d085baa tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:43.249637 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42b6ef99-5162-4dbc-99ec-73a29d085baa tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:43.255517 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42b6ef99-5162-4dbc-99ec-73a29d085baa tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:43.255999 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42b6ef99-5162-4dbc-99ec-73a29d085baa tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:43.256436 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42b6ef99-5162-4dbc-99ec-73a29d085baa tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:43.257127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42b6ef99-5162-4dbc-99ec-73a29d085baa tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:43.257598 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42b6ef99-5162-4dbc-99ec-73a29d085baa tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:43.258005 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42b6ef99-5162-4dbc-99ec-73a29d085baa tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:43.390068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-42b6ef99-5162-4dbc-99ec-73a29d085baa tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:43.398216 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42b6ef99-5162-4dbc-99ec-73a29d085baa tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1365 microversion: 2.1 time: 0.153040 Sep 09 13:15:43.398781 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 86/166] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:43 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:43.686140 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ccdb81ad-7af6-40b3-bf22-1e4c9e7e40b6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:43.687097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ccdb81ad-7af6-40b3-bf22-1e4c9e7e40b6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:43.694309 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ccdb81ad-7af6-40b3-bf22-1e4c9e7e40b6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:43.694875 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ccdb81ad-7af6-40b3-bf22-1e4c9e7e40b6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:43.695472 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ccdb81ad-7af6-40b3-bf22-1e4c9e7e40b6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:43.696601 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ccdb81ad-7af6-40b3-bf22-1e4c9e7e40b6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:43.697346 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ccdb81ad-7af6-40b3-bf22-1e4c9e7e40b6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:43.698094 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ccdb81ad-7af6-40b3-bf22-1e4c9e7e40b6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:43.790463 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5f7d215a-b915-4f6f-a407-178bfbb41dc2 req-828686e5-0f96-4441-bbad-9db54f81447b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14183836-171b-4a21-ae32-a214060081e8", "name": "network-vif-plugged", "status": "completed", "tag": "1b06de6b-62d9-4d8f-a0ad-1a6e7bf1b164"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:43.802293 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5f7d215a-b915-4f6f-a407-178bfbb41dc2 req-828686e5-0f96-4441-bbad-9db54f81447b service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:43.803322 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5f7d215a-b915-4f6f-a407-178bfbb41dc2 req-828686e5-0f96-4441-bbad-9db54f81447b service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:43.803879 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5f7d215a-b915-4f6f-a407-178bfbb41dc2 req-828686e5-0f96-4441-bbad-9db54f81447b service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:43.816683 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5f7d215a-b915-4f6f-a407-178bfbb41dc2 req-828686e5-0f96-4441-bbad-9db54f81447b service nova] Creating event network-vif-plugged:1b06de6b-62d9-4d8f-a0ad-1a6e7bf1b164 for instance 14183836-171b-4a21-ae32-a214060081e8 on hv-cinder-83124 Sep 09 13:15:43.822488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5f7d215a-b915-4f6f-a407-178bfbb41dc2 req-828686e5-0f96-4441-bbad-9db54f81447b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037104 Sep 09 13:15:43.823663 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 87/167] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:15:43.852588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ccdb81ad-7af6-40b3-bf22-1e4c9e7e40b6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:43.862214 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ccdb81ad-7af6-40b3-bf22-1e4c9e7e40b6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.180669 Sep 09 13:15:43.882066 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 81/168] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:43 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:44.155320 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-69d8fb6e-8541-4cbc-ba64-be779111062d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:44.156386 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-69d8fb6e-8541-4cbc-ba64-be779111062d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:44.164008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69d8fb6e-8541-4cbc-ba64-be779111062d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:44.164823 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69d8fb6e-8541-4cbc-ba64-be779111062d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:44.165418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69d8fb6e-8541-4cbc-ba64-be779111062d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:44.166120 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69d8fb6e-8541-4cbc-ba64-be779111062d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:44.166719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69d8fb6e-8541-4cbc-ba64-be779111062d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:44.167330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69d8fb6e-8541-4cbc-ba64-be779111062d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:44.224964 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e6675f50-747f-4176-ae01-084de063ce7d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:44.225581 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e6675f50-747f-4176-ae01-084de063ce7d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:44.232420 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6675f50-747f-4176-ae01-084de063ce7d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:44.232912 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6675f50-747f-4176-ae01-084de063ce7d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:44.233345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6675f50-747f-4176-ae01-084de063ce7d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:44.234043 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6675f50-747f-4176-ae01-084de063ce7d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:44.234658 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6675f50-747f-4176-ae01-084de063ce7d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:44.235319 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6675f50-747f-4176-ae01-084de063ce7d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:44.319945 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-69d8fb6e-8541-4cbc-ba64-be779111062d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:44.327910 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-69d8fb6e-8541-4cbc-ba64-be779111062d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1548 microversion: 2.1 time: 0.177788 Sep 09 13:15:44.328496 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 88/169] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:44 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:44.351472 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-438be4ef-c0f1-4db7-b1a1-978192438631 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:44.351964 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-438be4ef-c0f1-4db7-b1a1-978192438631 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:44.358440 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-438be4ef-c0f1-4db7-b1a1-978192438631 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:44.358934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-438be4ef-c0f1-4db7-b1a1-978192438631 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:44.359441 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-438be4ef-c0f1-4db7-b1a1-978192438631 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:44.360112 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-438be4ef-c0f1-4db7-b1a1-978192438631 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:44.360561 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-438be4ef-c0f1-4db7-b1a1-978192438631 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:44.360979 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-438be4ef-c0f1-4db7-b1a1-978192438631 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:44.375205 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e6675f50-747f-4176-ae01-084de063ce7d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:44.383068 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e6675f50-747f-4176-ae01-084de063ce7d tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1501 microversion: 2.1 time: 0.162179 Sep 09 13:15:44.383641 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 82/170] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:44 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:44.422567 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7ed28afb-1656-45b7-bd98-3990fbc38ebc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:44.423579 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7ed28afb-1656-45b7-bd98-3990fbc38ebc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:44.430889 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7ed28afb-1656-45b7-bd98-3990fbc38ebc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:44.431512 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7ed28afb-1656-45b7-bd98-3990fbc38ebc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:44.432041 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7ed28afb-1656-45b7-bd98-3990fbc38ebc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:44.432967 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7ed28afb-1656-45b7-bd98-3990fbc38ebc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:44.433539 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7ed28afb-1656-45b7-bd98-3990fbc38ebc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:44.434062 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7ed28afb-1656-45b7-bd98-3990fbc38ebc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:44.535313 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-438be4ef-c0f1-4db7-b1a1-978192438631 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.187911 Sep 09 13:15:44.543189 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 89/171] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 13:15:44 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/os-interface => generated 285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:15:44.876137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7ed28afb-1656-45b7-bd98-3990fbc38ebc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:44.888395 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5d47f57e-53d1-4271-b485-e55dfb82431d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:44.889010 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5d47f57e-53d1-4271-b485-e55dfb82431d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:44.890709 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7ed28afb-1656-45b7-bd98-3990fbc38ebc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1365 microversion: 2.1 time: 0.472164 Sep 09 13:15:44.892184 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 83/172] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:44 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1365 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:44.913521 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d47f57e-53d1-4271-b485-e55dfb82431d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:44.914490 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d47f57e-53d1-4271-b485-e55dfb82431d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:44.915245 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d47f57e-53d1-4271-b485-e55dfb82431d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:44.921501 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d47f57e-53d1-4271-b485-e55dfb82431d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:44.922664 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d47f57e-53d1-4271-b485-e55dfb82431d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:44.923763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5d47f57e-53d1-4271-b485-e55dfb82431d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:44.937948 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1098956707", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "networks": [{"uuid": "d12fe7e1-f7e0-4794-b29e-ff4e5939d9bc"}]}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:45.020002 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] validate_networks() for [('d12fe7e1-f7e0-4794-b29e-ff4e5939d9bc', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:15:45.118293 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5d47f57e-53d1-4271-b485-e55dfb82431d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:45.127507 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5d47f57e-53d1-4271-b485-e55dfb82431d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.243317 Sep 09 13:15:45.128674 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 90/173] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:44 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:45.917704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ed9712f-9aef-44f1-8b35-de8002dbe5a2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:45.918532 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5ed9712f-9aef-44f1-8b35-de8002dbe5a2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:45.945330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ed9712f-9aef-44f1-8b35-de8002dbe5a2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:45.946188 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ed9712f-9aef-44f1-8b35-de8002dbe5a2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:45.946646 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ed9712f-9aef-44f1-8b35-de8002dbe5a2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:45.947421 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ed9712f-9aef-44f1-8b35-de8002dbe5a2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:45.955968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ed9712f-9aef-44f1-8b35-de8002dbe5a2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:45.956691 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ed9712f-9aef-44f1-8b35-de8002dbe5a2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:46.159869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ed9712f-9aef-44f1-8b35-de8002dbe5a2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:46.170308 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ed9712f-9aef-44f1-8b35-de8002dbe5a2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1365 microversion: 2.1 time: 0.256353 Sep 09 13:15:46.170894 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 91/174] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:45 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:46.175847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ef47e04-2fcf-4505-b41d-3e9c7bba3c46 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d06f78c-3c6c-48e2-b3f5-7345192fe75a"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:46.179349 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ef47e04-2fcf-4505-b41d-3e9c7bba3c46 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:46.190527 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ef47e04-2fcf-4505-b41d-3e9c7bba3c46 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:46.191300 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ef47e04-2fcf-4505-b41d-3e9c7bba3c46 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:46.191738 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ef47e04-2fcf-4505-b41d-3e9c7bba3c46 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:46.192435 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ef47e04-2fcf-4505-b41d-3e9c7bba3c46 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:46.192888 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ef47e04-2fcf-4505-b41d-3e9c7bba3c46 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:46.193411 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ef47e04-2fcf-4505-b41d-3e9c7bba3c46 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:46.236413 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:15:46.236911 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:15:46.237184 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:15:46.237876 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:15:46.238681 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:15:46.250792 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:46.251907 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:46.252544 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:46.256403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:46.257473 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:46.258473 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:46.280683 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Getting quotas for project ca38013a20eb4c8e830e391cc06f485f. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:15:46.286539 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Getting quotas for user d73fdae39484489facaf6831430cd4d7 and project ca38013a20eb4c8e830e391cc06f485f. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:15:46.301078 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:15:46.303683 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:15:46.370433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b95a9c29-3476-4bbf-a544-c6e118086c4d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.436535 Sep 09 13:15:46.371509 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 84/175] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:15:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:15:46.378062 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-22f0b6de-1f23-4fc4-b7fe-993891bf3691 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:46.378926 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-22f0b6de-1f23-4fc4-b7fe-993891bf3691 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:46.385134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22f0b6de-1f23-4fc4-b7fe-993891bf3691 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:46.385690 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22f0b6de-1f23-4fc4-b7fe-993891bf3691 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:46.386188 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22f0b6de-1f23-4fc4-b7fe-993891bf3691 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:46.386943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22f0b6de-1f23-4fc4-b7fe-993891bf3691 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:46.387696 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22f0b6de-1f23-4fc4-b7fe-993891bf3691 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:46.388427 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22f0b6de-1f23-4fc4-b7fe-993891bf3691 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:46.667810 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-22f0b6de-1f23-4fc4-b7fe-993891bf3691 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:46.675816 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:46.687660 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-22f0b6de-1f23-4fc4-b7fe-993891bf3691 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1320 microversion: 2.1 time: 0.313463 Sep 09 13:15:46.689228 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 85/176] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:46 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1320 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:46.707891 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9645dd18-a2ab-4145-8640-91fb4e443197 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:46.708611 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9645dd18-a2ab-4145-8640-91fb4e443197 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:46.808691 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9645dd18-a2ab-4145-8640-91fb4e443197 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:46.819823 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9645dd18-a2ab-4145-8640-91fb4e443197 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1214 microversion: 2.1 time: 0.128479 Sep 09 13:15:46.820560 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 86/177] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:46 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:47.160133 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-24eb17fe-97b3-4528-81ad-7aa6c0da2072 req-0636f10a-15a8-49fa-82cc-81e3008409b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f12266-677e-473d-8fbd-bf3136398e58", "tag": "d0f7b8a7-7f54-44ba-988c-5391e6311e17"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:47.170809 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-24eb17fe-97b3-4528-81ad-7aa6c0da2072 req-0636f10a-15a8-49fa-82cc-81e3008409b7 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:47.171687 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-24eb17fe-97b3-4528-81ad-7aa6c0da2072 req-0636f10a-15a8-49fa-82cc-81e3008409b7 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:47.172363 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-24eb17fe-97b3-4528-81ad-7aa6c0da2072 req-0636f10a-15a8-49fa-82cc-81e3008409b7 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:47.185077 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-24eb17fe-97b3-4528-81ad-7aa6c0da2072 req-0636f10a-15a8-49fa-82cc-81e3008409b7 service nova] Creating event network-changed:d0f7b8a7-7f54-44ba-988c-5391e6311e17 for instance d7f12266-677e-473d-8fbd-bf3136398e58 on hv-cinder-83124 Sep 09 13:15:47.190537 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-24eb17fe-97b3-4528-81ad-7aa6c0da2072 req-0636f10a-15a8-49fa-82cc-81e3008409b7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034033 Sep 09 13:15:47.191412 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 87/178] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:15:47.198015 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bda43747-2dee-4256-a77c-6a3b2be5d1df tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:47.198894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bda43747-2dee-4256-a77c-6a3b2be5d1df tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:47.206116 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bda43747-2dee-4256-a77c-6a3b2be5d1df tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:47.206861 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bda43747-2dee-4256-a77c-6a3b2be5d1df tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:47.207369 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bda43747-2dee-4256-a77c-6a3b2be5d1df tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:47.208083 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bda43747-2dee-4256-a77c-6a3b2be5d1df tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:47.208740 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bda43747-2dee-4256-a77c-6a3b2be5d1df tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:47.209232 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bda43747-2dee-4256-a77c-6a3b2be5d1df tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:47.360538 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bda43747-2dee-4256-a77c-6a3b2be5d1df tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:47.373097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bda43747-2dee-4256-a77c-6a3b2be5d1df tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1365 microversion: 2.1 time: 0.178991 Sep 09 13:15:47.374092 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 88/179] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:47 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:47.714823 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-01198385-7c7d-4776-8846-324748ee2ad6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:47.716041 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-01198385-7c7d-4776-8846-324748ee2ad6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:47.723526 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01198385-7c7d-4776-8846-324748ee2ad6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:47.724312 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01198385-7c7d-4776-8846-324748ee2ad6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:47.724922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01198385-7c7d-4776-8846-324748ee2ad6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:47.726171 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01198385-7c7d-4776-8846-324748ee2ad6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:47.726951 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01198385-7c7d-4776-8846-324748ee2ad6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:47.727903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01198385-7c7d-4776-8846-324748ee2ad6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:47.780056 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ef47e04-2fcf-4505-b41d-3e9c7bba3c46 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "POST /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.607880 Sep 09 13:15:47.780668 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 92/180] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 13:15:46 2022] POST /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7/os-volume_attachments => generated 194 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:15:47.846066 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0f4c1e8b-5928-436b-b79b-efb09fa295eb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:47.847192 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0f4c1e8b-5928-436b-b79b-efb09fa295eb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:47.864398 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f4c1e8b-5928-436b-b79b-efb09fa295eb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:47.865008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f4c1e8b-5928-436b-b79b-efb09fa295eb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:47.865637 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f4c1e8b-5928-436b-b79b-efb09fa295eb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:47.866687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f4c1e8b-5928-436b-b79b-efb09fa295eb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:47.867244 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f4c1e8b-5928-436b-b79b-efb09fa295eb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:47.867687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0f4c1e8b-5928-436b-b79b-efb09fa295eb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:47.897299 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-01198385-7c7d-4776-8846-324748ee2ad6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:47.907925 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-01198385-7c7d-4776-8846-324748ee2ad6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1514 microversion: 2.1 time: 0.196796 Sep 09 13:15:47.908834 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 89/181] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:47 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:47.932843 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5944eb01-74f8-42d7-a3f4-dc8c95353d12 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:47.936230 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5944eb01-74f8-42d7-a3f4-dc8c95353d12 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:47.944260 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5944eb01-74f8-42d7-a3f4-dc8c95353d12 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:47.945432 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5944eb01-74f8-42d7-a3f4-dc8c95353d12 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:47.946121 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5944eb01-74f8-42d7-a3f4-dc8c95353d12 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:47.946989 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5944eb01-74f8-42d7-a3f4-dc8c95353d12 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:47.947629 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5944eb01-74f8-42d7-a3f4-dc8c95353d12 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:47.948272 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5944eb01-74f8-42d7-a3f4-dc8c95353d12 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:48.007404 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0f4c1e8b-5928-436b-b79b-efb09fa295eb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:48.025492 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0f4c1e8b-5928-436b-b79b-efb09fa295eb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1218 microversion: 2.1 time: 0.185160 Sep 09 13:15:48.026156 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 93/182] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:47 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:48.038270 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-5944eb01-74f8-42d7-a3f4-dc8c95353d12 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lazy-loading 'flavor' on Instance uuid 1258804f-2f19-4ed2-94c2-0d75ea5360e5 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:15:48.294331 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5944eb01-74f8-42d7-a3f4-dc8c95353d12 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "POST /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5/action" status: 200 len: 32 microversion: 2.1 time: 0.365262 Sep 09 13:15:48.295282 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 90/183] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 13:15:47 2022] POST /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5/action => generated 32 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 13:15:48.308630 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d35d4fbb-4270-4031-88a0-758ab4edcf31 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:48.310799 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d35d4fbb-4270-4031-88a0-758ab4edcf31 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:48.323580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d35d4fbb-4270-4031-88a0-758ab4edcf31 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:48.324382 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d35d4fbb-4270-4031-88a0-758ab4edcf31 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:48.325712 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d35d4fbb-4270-4031-88a0-758ab4edcf31 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:48.329141 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d35d4fbb-4270-4031-88a0-758ab4edcf31 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:48.330569 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d35d4fbb-4270-4031-88a0-758ab4edcf31 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:48.331326 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d35d4fbb-4270-4031-88a0-758ab4edcf31 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:48.404336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5ed8c177-6184-4d35-b14e-778f914bd1ea tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:48.406530 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5ed8c177-6184-4d35-b14e-778f914bd1ea tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:48.419604 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ed8c177-6184-4d35-b14e-778f914bd1ea tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:48.423084 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ed8c177-6184-4d35-b14e-778f914bd1ea tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:48.425164 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ed8c177-6184-4d35-b14e-778f914bd1ea tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:48.426323 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ed8c177-6184-4d35-b14e-778f914bd1ea tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:48.428279 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ed8c177-6184-4d35-b14e-778f914bd1ea tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:48.429671 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5ed8c177-6184-4d35-b14e-778f914bd1ea tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:48.618423 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d35d4fbb-4270-4031-88a0-758ab4edcf31 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:48.630751 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d35d4fbb-4270-4031-88a0-758ab4edcf31 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.328879 Sep 09 13:15:48.641497 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 94/184] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:48 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:48.890916 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5ed8c177-6184-4d35-b14e-778f914bd1ea tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:48.909292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5ed8c177-6184-4d35-b14e-778f914bd1ea tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1556 microversion: 2.1 time: 0.515326 Sep 09 13:15:48.910186 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 91/185] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:48 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1556 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:48.935292 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9c5a9b05-adfa-4b88-835f-31bbb2219d3f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:48.936383 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9c5a9b05-adfa-4b88-835f-31bbb2219d3f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:48.943595 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c5a9b05-adfa-4b88-835f-31bbb2219d3f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:48.945087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c5a9b05-adfa-4b88-835f-31bbb2219d3f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:48.945655 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c5a9b05-adfa-4b88-835f-31bbb2219d3f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:48.946503 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c5a9b05-adfa-4b88-835f-31bbb2219d3f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:48.947337 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c5a9b05-adfa-4b88-835f-31bbb2219d3f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:48.947906 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c5a9b05-adfa-4b88-835f-31bbb2219d3f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:49.057965 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b11b4dd0-538a-4fd5-b272-2c6d8127d9ce tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:49.059757 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b11b4dd0-538a-4fd5-b272-2c6d8127d9ce tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:49.067968 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b11b4dd0-538a-4fd5-b272-2c6d8127d9ce tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:49.069058 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b11b4dd0-538a-4fd5-b272-2c6d8127d9ce tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:49.069677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b11b4dd0-538a-4fd5-b272-2c6d8127d9ce tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:49.070682 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b11b4dd0-538a-4fd5-b272-2c6d8127d9ce tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:49.071405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b11b4dd0-538a-4fd5-b272-2c6d8127d9ce tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:49.072116 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b11b4dd0-538a-4fd5-b272-2c6d8127d9ce tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:49.092944 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9c5a9b05-adfa-4b88-835f-31bbb2219d3f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162729 Sep 09 13:15:49.093736 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 95/186] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 13:15:48 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:15:49.205402 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b11b4dd0-538a-4fd5-b272-2c6d8127d9ce tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:49.217801 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b11b4dd0-538a-4fd5-b272-2c6d8127d9ce tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1266 microversion: 2.1 time: 0.165401 Sep 09 13:15:49.231838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 92/187] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:49 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:49.656549 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9bc79d78-0d03-49ad-b98a-8f3ae5d92b40 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:49.657459 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9bc79d78-0d03-49ad-b98a-8f3ae5d92b40 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:49.664104 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bc79d78-0d03-49ad-b98a-8f3ae5d92b40 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:49.664839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bc79d78-0d03-49ad-b98a-8f3ae5d92b40 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:49.665453 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bc79d78-0d03-49ad-b98a-8f3ae5d92b40 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:49.666171 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bc79d78-0d03-49ad-b98a-8f3ae5d92b40 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:49.666630 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bc79d78-0d03-49ad-b98a-8f3ae5d92b40 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:49.667077 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9bc79d78-0d03-49ad-b98a-8f3ae5d92b40 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:50.243687 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-725ff7a3-5aac-48b5-8348-7894abc500a3 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:50.244279 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-725ff7a3-5aac-48b5-8348-7894abc500a3 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:50.258586 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-725ff7a3-5aac-48b5-8348-7894abc500a3 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:50.259145 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-725ff7a3-5aac-48b5-8348-7894abc500a3 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:50.259526 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-725ff7a3-5aac-48b5-8348-7894abc500a3 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:50.260223 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-725ff7a3-5aac-48b5-8348-7894abc500a3 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:50.260839 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-725ff7a3-5aac-48b5-8348-7894abc500a3 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:50.261520 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-725ff7a3-5aac-48b5-8348-7894abc500a3 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:50.360719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9bc79d78-0d03-49ad-b98a-8f3ae5d92b40 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:50.369959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9bc79d78-0d03-49ad-b98a-8f3ae5d92b40 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.717917 Sep 09 13:15:50.371021 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 96/188] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:49 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:50.410139 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-725ff7a3-5aac-48b5-8348-7894abc500a3 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:50.427256 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-725ff7a3-5aac-48b5-8348-7894abc500a3 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1272 microversion: 2.1 time: 0.187697 Sep 09 13:15:50.443264 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 93/189] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:50 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:51.269394 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-70f01b4d-9f0b-49ea-8061-04f76c39fffb req-d226a010-4788-426a-affb-d8f256614232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14183836-171b-4a21-ae32-a214060081e8", "tag": "1b06de6b-62d9-4d8f-a0ad-1a6e7bf1b164"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:51.284402 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-70f01b4d-9f0b-49ea-8061-04f76c39fffb req-d226a010-4788-426a-affb-d8f256614232 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:51.285317 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-70f01b4d-9f0b-49ea-8061-04f76c39fffb req-d226a010-4788-426a-affb-d8f256614232 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:51.286791 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-70f01b4d-9f0b-49ea-8061-04f76c39fffb req-d226a010-4788-426a-affb-d8f256614232 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:51.301759 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-70f01b4d-9f0b-49ea-8061-04f76c39fffb req-d226a010-4788-426a-affb-d8f256614232 service nova] Creating event network-changed:1b06de6b-62d9-4d8f-a0ad-1a6e7bf1b164 for instance 14183836-171b-4a21-ae32-a214060081e8 on hv-cinder-83124 Sep 09 13:15:51.312942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-70f01b4d-9f0b-49ea-8061-04f76c39fffb req-d226a010-4788-426a-affb-d8f256614232 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048709 Sep 09 13:15:51.314334 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 97/190] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:15:51.396674 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6e8e9efb-2eb5-4962-8ae4-b9558b1556e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:51.398201 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6e8e9efb-2eb5-4962-8ae4-b9558b1556e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:51.410929 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e8e9efb-2eb5-4962-8ae4-b9558b1556e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:51.411797 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e8e9efb-2eb5-4962-8ae4-b9558b1556e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:51.412487 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e8e9efb-2eb5-4962-8ae4-b9558b1556e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:51.414260 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e8e9efb-2eb5-4962-8ae4-b9558b1556e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:51.415241 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e8e9efb-2eb5-4962-8ae4-b9558b1556e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:51.415910 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6e8e9efb-2eb5-4962-8ae4-b9558b1556e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:51.461307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5e9044c9-f5f8-4d80-8efe-5bcde6135d74 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:51.465075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5e9044c9-f5f8-4d80-8efe-5bcde6135d74 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:51.482603 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e9044c9-f5f8-4d80-8efe-5bcde6135d74 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:51.484044 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e9044c9-f5f8-4d80-8efe-5bcde6135d74 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:51.484684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e9044c9-f5f8-4d80-8efe-5bcde6135d74 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:51.485652 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e9044c9-f5f8-4d80-8efe-5bcde6135d74 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:51.486336 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e9044c9-f5f8-4d80-8efe-5bcde6135d74 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:51.486981 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5e9044c9-f5f8-4d80-8efe-5bcde6135d74 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:51.756232 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6e8e9efb-2eb5-4962-8ae4-b9558b1556e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:51.770344 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6e8e9efb-2eb5-4962-8ae4-b9558b1556e2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.380198 Sep 09 13:15:51.772260 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 94/191] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:51 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:51.941964 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-50bcc204-6bca-4689-a055-b8e9a3b2b3ec req-b12ec414-0078-4c0c-ac8a-28a912ffc7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972dd913-26df-4c31-bc52-20f28ce57749", "tag": "02db944a-497e-4ba0-9f8b-7ad9adaf52b4"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:15:51.973484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-50bcc204-6bca-4689-a055-b8e9a3b2b3ec req-b12ec414-0078-4c0c-ac8a-28a912ffc7d7 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:51.974259 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-50bcc204-6bca-4689-a055-b8e9a3b2b3ec req-b12ec414-0078-4c0c-ac8a-28a912ffc7d7 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:51.974854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-50bcc204-6bca-4689-a055-b8e9a3b2b3ec req-b12ec414-0078-4c0c-ac8a-28a912ffc7d7 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:52.002065 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-50bcc204-6bca-4689-a055-b8e9a3b2b3ec req-b12ec414-0078-4c0c-ac8a-28a912ffc7d7 service nova] Creating event network-changed:02db944a-497e-4ba0-9f8b-7ad9adaf52b4 for instance 972dd913-26df-4c31-bc52-20f28ce57749 on hv-cinder-83124 Sep 09 13:15:52.011162 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-50bcc204-6bca-4689-a055-b8e9a3b2b3ec req-b12ec414-0078-4c0c-ac8a-28a912ffc7d7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074208 Sep 09 13:15:52.014548 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 95/192] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:15:52.318915 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5e9044c9-f5f8-4d80-8efe-5bcde6135d74 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:52.331903 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5e9044c9-f5f8-4d80-8efe-5bcde6135d74 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1314 microversion: 2.1 time: 0.878542 Sep 09 13:15:52.332512 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 98/193] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:51 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:52.796191 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-98ac31c7-7eb6-46f8-a4eb-7049114c7b30 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:52.796903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-98ac31c7-7eb6-46f8-a4eb-7049114c7b30 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:52.807149 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98ac31c7-7eb6-46f8-a4eb-7049114c7b30 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:52.807149 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98ac31c7-7eb6-46f8-a4eb-7049114c7b30 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:52.807149 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98ac31c7-7eb6-46f8-a4eb-7049114c7b30 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:52.807149 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98ac31c7-7eb6-46f8-a4eb-7049114c7b30 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:52.807498 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98ac31c7-7eb6-46f8-a4eb-7049114c7b30 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:52.807589 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98ac31c7-7eb6-46f8-a4eb-7049114c7b30 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:53.017433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-98ac31c7-7eb6-46f8-a4eb-7049114c7b30 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:53.027716 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-98ac31c7-7eb6-46f8-a4eb-7049114c7b30 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.236175 Sep 09 13:15:53.028980 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 96/194] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:52 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:53.358974 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0b63f324-479f-4c8f-9690-4323d4bb7a99 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:53.360333 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0b63f324-479f-4c8f-9690-4323d4bb7a99 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:53.368037 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b63f324-479f-4c8f-9690-4323d4bb7a99 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:53.368751 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b63f324-479f-4c8f-9690-4323d4bb7a99 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:53.369253 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b63f324-479f-4c8f-9690-4323d4bb7a99 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:53.370021 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b63f324-479f-4c8f-9690-4323d4bb7a99 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:53.370543 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b63f324-479f-4c8f-9690-4323d4bb7a99 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:53.371128 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b63f324-479f-4c8f-9690-4323d4bb7a99 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:53.521240 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0b63f324-479f-4c8f-9690-4323d4bb7a99 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:53.530845 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0b63f324-479f-4c8f-9690-4323d4bb7a99 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1314 microversion: 2.1 time: 0.176798 Sep 09 13:15:53.531679 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 99/195] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:53 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:15:54.051523 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-685ca145-5405-44c4-a4a8-9752599708f7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:54.052843 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-685ca145-5405-44c4-a4a8-9752599708f7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:54.061249 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-685ca145-5405-44c4-a4a8-9752599708f7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:54.062078 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-685ca145-5405-44c4-a4a8-9752599708f7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:54.062733 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-685ca145-5405-44c4-a4a8-9752599708f7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:54.063813 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-685ca145-5405-44c4-a4a8-9752599708f7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:54.064341 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-685ca145-5405-44c4-a4a8-9752599708f7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:54.064837 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-685ca145-5405-44c4-a4a8-9752599708f7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:54.289108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-685ca145-5405-44c4-a4a8-9752599708f7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:54.303954 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-685ca145-5405-44c4-a4a8-9752599708f7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.255740 Sep 09 13:15:54.318580 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 97/196] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:54 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:54.553508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6bdf0ec5-88e0-4ba7-8430-94c06dcbdb3e tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:54.554047 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6bdf0ec5-88e0-4ba7-8430-94c06dcbdb3e tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:54.561042 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6bdf0ec5-88e0-4ba7-8430-94c06dcbdb3e tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:54.561517 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6bdf0ec5-88e0-4ba7-8430-94c06dcbdb3e tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:54.562146 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6bdf0ec5-88e0-4ba7-8430-94c06dcbdb3e tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:54.563002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6bdf0ec5-88e0-4ba7-8430-94c06dcbdb3e tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:54.563480 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6bdf0ec5-88e0-4ba7-8430-94c06dcbdb3e tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:54.563896 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6bdf0ec5-88e0-4ba7-8430-94c06dcbdb3e tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:54.758607 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6bdf0ec5-88e0-4ba7-8430-94c06dcbdb3e tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:54.767949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6bdf0ec5-88e0-4ba7-8430-94c06dcbdb3e tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1314 microversion: 2.1 time: 0.218176 Sep 09 13:15:54.769233 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 100/197] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:54 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:55.333255 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-04c4782b-04e6-4b97-96c6-28dd2a2d972a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:55.334012 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-04c4782b-04e6-4b97-96c6-28dd2a2d972a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:55.340955 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04c4782b-04e6-4b97-96c6-28dd2a2d972a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:55.341940 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04c4782b-04e6-4b97-96c6-28dd2a2d972a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:55.342378 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04c4782b-04e6-4b97-96c6-28dd2a2d972a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:55.343152 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04c4782b-04e6-4b97-96c6-28dd2a2d972a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:55.343880 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04c4782b-04e6-4b97-96c6-28dd2a2d972a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:55.344482 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04c4782b-04e6-4b97-96c6-28dd2a2d972a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:55.528530 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-04c4782b-04e6-4b97-96c6-28dd2a2d972a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:55.536570 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-04c4782b-04e6-4b97-96c6-28dd2a2d972a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.209616 Sep 09 13:15:55.537136 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 98/198] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:55 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:55.793370 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ccde7c27-8a04-4a34-9a46-22ef66594ba7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:55.794400 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ccde7c27-8a04-4a34-9a46-22ef66594ba7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:55.800539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccde7c27-8a04-4a34-9a46-22ef66594ba7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:55.801020 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccde7c27-8a04-4a34-9a46-22ef66594ba7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:55.801450 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccde7c27-8a04-4a34-9a46-22ef66594ba7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:55.802136 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccde7c27-8a04-4a34-9a46-22ef66594ba7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:55.802585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccde7c27-8a04-4a34-9a46-22ef66594ba7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:55.802999 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccde7c27-8a04-4a34-9a46-22ef66594ba7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:55.940703 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ccde7c27-8a04-4a34-9a46-22ef66594ba7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:55.948497 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ccde7c27-8a04-4a34-9a46-22ef66594ba7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1314 microversion: 2.1 time: 0.159212 Sep 09 13:15:55.949058 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 101/199] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:55 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:56.560449 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ee9ab1f9-a604-47da-80f7-139a97f55553 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:56.561674 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ee9ab1f9-a604-47da-80f7-139a97f55553 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:56.563841 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:56.570110 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee9ab1f9-a604-47da-80f7-139a97f55553 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:56.570581 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee9ab1f9-a604-47da-80f7-139a97f55553 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:56.571444 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee9ab1f9-a604-47da-80f7-139a97f55553 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:56.572210 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee9ab1f9-a604-47da-80f7-139a97f55553 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:56.572689 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee9ab1f9-a604-47da-80f7-139a97f55553 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:56.573173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ee9ab1f9-a604-47da-80f7-139a97f55553 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:56.733981 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ee9ab1f9-a604-47da-80f7-139a97f55553 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:56.743487 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ee9ab1f9-a604-47da-80f7-139a97f55553 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.187991 Sep 09 13:15:56.744251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 99/200] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:56 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:56.971991 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-94d050c9-f3a1-46d3-bf50-cf365f01cc13 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:56.972744 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-94d050c9-f3a1-46d3-bf50-cf365f01cc13 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:56.979265 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94d050c9-f3a1-46d3-bf50-cf365f01cc13 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:56.979750 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94d050c9-f3a1-46d3-bf50-cf365f01cc13 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:56.980183 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94d050c9-f3a1-46d3-bf50-cf365f01cc13 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:56.980873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94d050c9-f3a1-46d3-bf50-cf365f01cc13 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:56.982009 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94d050c9-f3a1-46d3-bf50-cf365f01cc13 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:56.982473 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-94d050c9-f3a1-46d3-bf50-cf365f01cc13 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:57.152805 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-94d050c9-f3a1-46d3-bf50-cf365f01cc13 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:57.161083 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-94d050c9-f3a1-46d3-bf50-cf365f01cc13 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1314 microversion: 2.1 time: 0.192909 Sep 09 13:15:57.161736 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 102/201] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:56 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:57.768766 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d8a449a5-7c2c-4dc3-aaa7-19658fcb0d9d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:57.769497 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d8a449a5-7c2c-4dc3-aaa7-19658fcb0d9d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:57.771458 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=8 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:57.776879 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a449a5-7c2c-4dc3-aaa7-19658fcb0d9d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:57.777367 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a449a5-7c2c-4dc3-aaa7-19658fcb0d9d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:57.777803 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a449a5-7c2c-4dc3-aaa7-19658fcb0d9d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:57.779393 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a449a5-7c2c-4dc3-aaa7-19658fcb0d9d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:57.779867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a449a5-7c2c-4dc3-aaa7-19658fcb0d9d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:57.780299 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d8a449a5-7c2c-4dc3-aaa7-19658fcb0d9d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:57.912751 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d8a449a5-7c2c-4dc3-aaa7-19658fcb0d9d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:57.922709 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d8a449a5-7c2c-4dc3-aaa7-19658fcb0d9d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.157764 Sep 09 13:15:57.923949 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 100/202] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:57 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:58.186206 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6dc802ef-6506-4a42-ad30-75e3437115fb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:58.186819 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6dc802ef-6506-4a42-ad30-75e3437115fb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:58.193214 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6dc802ef-6506-4a42-ad30-75e3437115fb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:58.193697 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6dc802ef-6506-4a42-ad30-75e3437115fb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:58.194140 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6dc802ef-6506-4a42-ad30-75e3437115fb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:58.194835 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6dc802ef-6506-4a42-ad30-75e3437115fb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:58.195316 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6dc802ef-6506-4a42-ad30-75e3437115fb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:58.195742 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6dc802ef-6506-4a42-ad30-75e3437115fb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:58.199800 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:15:58.339259 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6dc802ef-6506-4a42-ad30-75e3437115fb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:58.348650 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6dc802ef-6506-4a42-ad30-75e3437115fb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1314 microversion: 2.1 time: 0.166144 Sep 09 13:15:58.349212 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 103/203] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:58 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:58.949231 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2e9d1bf4-b3e3-4ec6-95e2-e4e24b5c4d2a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:58.951013 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2e9d1bf4-b3e3-4ec6-95e2-e4e24b5c4d2a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:58.957456 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e9d1bf4-b3e3-4ec6-95e2-e4e24b5c4d2a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:58.957943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e9d1bf4-b3e3-4ec6-95e2-e4e24b5c4d2a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:58.958382 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e9d1bf4-b3e3-4ec6-95e2-e4e24b5c4d2a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:58.959154 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e9d1bf4-b3e3-4ec6-95e2-e4e24b5c4d2a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:58.959614 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e9d1bf4-b3e3-4ec6-95e2-e4e24b5c4d2a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:58.960040 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e9d1bf4-b3e3-4ec6-95e2-e4e24b5c4d2a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:59.097476 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2e9d1bf4-b3e3-4ec6-95e2-e4e24b5c4d2a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:59.105010 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2e9d1bf4-b3e3-4ec6-95e2-e4e24b5c4d2a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.160065 Sep 09 13:15:59.105574 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 101/204] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:58 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:15:59.372583 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-60aff340-915b-4855-abc7-dfa8b7b82a60 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:15:59.373360 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-60aff340-915b-4855-abc7-dfa8b7b82a60 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:15:59.380446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60aff340-915b-4855-abc7-dfa8b7b82a60 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:59.380948 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60aff340-915b-4855-abc7-dfa8b7b82a60 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:59.381787 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60aff340-915b-4855-abc7-dfa8b7b82a60 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:59.382614 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60aff340-915b-4855-abc7-dfa8b7b82a60 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:15:59.383115 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60aff340-915b-4855-abc7-dfa8b7b82a60 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:15:59.383571 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-60aff340-915b-4855-abc7-dfa8b7b82a60 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:15:59.564985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-60aff340-915b-4855-abc7-dfa8b7b82a60 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:15:59.573647 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-60aff340-915b-4855-abc7-dfa8b7b82a60 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1314 microversion: 2.1 time: 0.204888 Sep 09 13:15:59.574556 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 104/205] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:15:59 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:00.128386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-dc3d32d7-4a8c-4f9d-bb10-6f2d263b9745 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:00.129620 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-dc3d32d7-4a8c-4f9d-bb10-6f2d263b9745 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:00.135704 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dc3d32d7-4a8c-4f9d-bb10-6f2d263b9745 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:00.136197 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dc3d32d7-4a8c-4f9d-bb10-6f2d263b9745 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:00.136629 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dc3d32d7-4a8c-4f9d-bb10-6f2d263b9745 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:00.137438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dc3d32d7-4a8c-4f9d-bb10-6f2d263b9745 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:00.138150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dc3d32d7-4a8c-4f9d-bb10-6f2d263b9745 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:00.138588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dc3d32d7-4a8c-4f9d-bb10-6f2d263b9745 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:00.294329 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-dc3d32d7-4a8c-4f9d-bb10-6f2d263b9745 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:00.299076 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:00.310660 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-dc3d32d7-4a8c-4f9d-bb10-6f2d263b9745 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.185959 Sep 09 13:16:00.311501 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 102/206] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:00 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:00.602080 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1218e64f-8208-4076-805f-d1475423c985 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:00.602556 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1218e64f-8208-4076-805f-d1475423c985 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:00.614116 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1218e64f-8208-4076-805f-d1475423c985 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:00.615398 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1218e64f-8208-4076-805f-d1475423c985 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:00.615842 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1218e64f-8208-4076-805f-d1475423c985 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:00.616548 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1218e64f-8208-4076-805f-d1475423c985 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:00.617019 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1218e64f-8208-4076-805f-d1475423c985 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:00.617419 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1218e64f-8208-4076-805f-d1475423c985 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:00.803726 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1218e64f-8208-4076-805f-d1475423c985 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:00.813684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1218e64f-8208-4076-805f-d1475423c985 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1314 microversion: 2.1 time: 0.215830 Sep 09 13:16:00.814267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 105/207] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:00 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:01.334058 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b1438d40-f377-485d-83ca-895789b39f5f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:01.334674 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b1438d40-f377-485d-83ca-895789b39f5f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:01.342471 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b1438d40-f377-485d-83ca-895789b39f5f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:01.342874 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b1438d40-f377-485d-83ca-895789b39f5f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:01.343343 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b1438d40-f377-485d-83ca-895789b39f5f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:01.344046 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b1438d40-f377-485d-83ca-895789b39f5f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:01.344502 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b1438d40-f377-485d-83ca-895789b39f5f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:01.344904 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b1438d40-f377-485d-83ca-895789b39f5f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:01.501483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b1438d40-f377-485d-83ca-895789b39f5f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:01.509041 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b1438d40-f377-485d-83ca-895789b39f5f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.179173 Sep 09 13:16:01.509839 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 103/208] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:01 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:01.837559 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-50a18c3a-0a3f-4eb5-9c8a-dda08887fe92 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:01.838258 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-50a18c3a-0a3f-4eb5-9c8a-dda08887fe92 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:01.845749 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50a18c3a-0a3f-4eb5-9c8a-dda08887fe92 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:01.846319 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50a18c3a-0a3f-4eb5-9c8a-dda08887fe92 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:01.846820 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50a18c3a-0a3f-4eb5-9c8a-dda08887fe92 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:01.847642 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50a18c3a-0a3f-4eb5-9c8a-dda08887fe92 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:01.848166 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50a18c3a-0a3f-4eb5-9c8a-dda08887fe92 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:01.848765 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50a18c3a-0a3f-4eb5-9c8a-dda08887fe92 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:02.031474 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-50a18c3a-0a3f-4eb5-9c8a-dda08887fe92 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:02.040318 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-50a18c3a-0a3f-4eb5-9c8a-dda08887fe92 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1314 microversion: 2.1 time: 0.206833 Sep 09 13:16:02.040909 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 106/209] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:01 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:02.536329 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-90c1ef9b-756f-4141-896a-7509b542364c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:02.536968 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-90c1ef9b-756f-4141-896a-7509b542364c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:02.543012 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90c1ef9b-756f-4141-896a-7509b542364c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:02.543709 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90c1ef9b-756f-4141-896a-7509b542364c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:02.544471 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90c1ef9b-756f-4141-896a-7509b542364c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:02.545231 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90c1ef9b-756f-4141-896a-7509b542364c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:02.545741 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90c1ef9b-756f-4141-896a-7509b542364c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:02.546275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90c1ef9b-756f-4141-896a-7509b542364c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:02.676596 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-90c1ef9b-756f-4141-896a-7509b542364c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:02.684820 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-90c1ef9b-756f-4141-896a-7509b542364c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.151900 Sep 09 13:16:02.685382 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 104/210] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:02 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:02.868000 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c657ef8a-1574-4b16-8960-050238b952a9 req-00d8295c-8209-474a-870d-1fbe8a7c94f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972dd913-26df-4c31-bc52-20f28ce57749", "name": "network-vif-plugged", "status": "completed", "tag": "02db944a-497e-4ba0-9f8b-7ad9adaf52b4"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:02.880219 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c657ef8a-1574-4b16-8960-050238b952a9 req-00d8295c-8209-474a-870d-1fbe8a7c94f4 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:02.880935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c657ef8a-1574-4b16-8960-050238b952a9 req-00d8295c-8209-474a-870d-1fbe8a7c94f4 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:02.881360 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c657ef8a-1574-4b16-8960-050238b952a9 req-00d8295c-8209-474a-870d-1fbe8a7c94f4 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:02.894723 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c657ef8a-1574-4b16-8960-050238b952a9 req-00d8295c-8209-474a-870d-1fbe8a7c94f4 service nova] Creating event network-vif-plugged:02db944a-497e-4ba0-9f8b-7ad9adaf52b4 for instance 972dd913-26df-4c31-bc52-20f28ce57749 on hv-cinder-83124 Sep 09 13:16:02.899936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c657ef8a-1574-4b16-8960-050238b952a9 req-00d8295c-8209-474a-870d-1fbe8a7c94f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036281 Sep 09 13:16:02.900768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 107/211] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:16:03.064526 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d1c76902-4628-4ead-94e2-54e95a850db4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:03.064526 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d1c76902-4628-4ead-94e2-54e95a850db4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:03.075638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1c76902-4628-4ead-94e2-54e95a850db4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:03.078003 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1c76902-4628-4ead-94e2-54e95a850db4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:03.078449 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1c76902-4628-4ead-94e2-54e95a850db4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:03.079193 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1c76902-4628-4ead-94e2-54e95a850db4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:03.080001 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1c76902-4628-4ead-94e2-54e95a850db4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:03.088069 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1c76902-4628-4ead-94e2-54e95a850db4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:03.335621 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d1c76902-4628-4ead-94e2-54e95a850db4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:03.337499 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fc516efd-c348-4692-91c6-526b27449723 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:03.338072 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fc516efd-c348-4692-91c6-526b27449723 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:03.345505 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc516efd-c348-4692-91c6-526b27449723 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:03.345744 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d1c76902-4628-4ead-94e2-54e95a850db4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1314 microversion: 2.1 time: 0.286176 Sep 09 13:16:03.346538 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 105/212] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:03 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:03.358280 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc516efd-c348-4692-91c6-526b27449723 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:03.358280 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc516efd-c348-4692-91c6-526b27449723 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:03.358280 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc516efd-c348-4692-91c6-526b27449723 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:03.358280 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc516efd-c348-4692-91c6-526b27449723 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:03.358963 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fc516efd-c348-4692-91c6-526b27449723 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:03.387931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fc516efd-c348-4692-91c6-526b27449723 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:16:03.496624 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fc516efd-c348-4692-91c6-526b27449723 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "DELETE /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 204 len: 0 microversion: 2.1 time: 0.163029 Sep 09 13:16:03.497681 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 108/213] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:16:03 2022] DELETE /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 13:16:03.506221 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1a898321-1976-49b8-ad89-51b45950d3a2 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:03.507467 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1a898321-1976-49b8-ad89-51b45950d3a2 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:03.513919 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a898321-1976-49b8-ad89-51b45950d3a2 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:03.514410 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a898321-1976-49b8-ad89-51b45950d3a2 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:03.515013 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a898321-1976-49b8-ad89-51b45950d3a2 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:03.515901 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a898321-1976-49b8-ad89-51b45950d3a2 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:03.516654 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a898321-1976-49b8-ad89-51b45950d3a2 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:03.517254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a898321-1976-49b8-ad89-51b45950d3a2 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:03.668158 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1a898321-1976-49b8-ad89-51b45950d3a2 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:03.676922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1a898321-1976-49b8-ad89-51b45950d3a2 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1553 microversion: 2.1 time: 0.174766 Sep 09 13:16:03.677485 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 106/214] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:03 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:03.707761 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-16b07467-2a00-4705-addb-8cfaf56f77c8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:03.708450 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-16b07467-2a00-4705-addb-8cfaf56f77c8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:03.714146 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16b07467-2a00-4705-addb-8cfaf56f77c8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:03.714640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16b07467-2a00-4705-addb-8cfaf56f77c8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:03.715065 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16b07467-2a00-4705-addb-8cfaf56f77c8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:03.716576 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16b07467-2a00-4705-addb-8cfaf56f77c8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:03.717209 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16b07467-2a00-4705-addb-8cfaf56f77c8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:03.717631 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16b07467-2a00-4705-addb-8cfaf56f77c8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:03.850938 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-16b07467-2a00-4705-addb-8cfaf56f77c8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:03.858914 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-16b07467-2a00-4705-addb-8cfaf56f77c8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.155468 Sep 09 13:16:03.859635 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 109/215] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:03 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:04.370358 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-da433523-792d-428b-a875-44720d519233 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:04.370969 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-da433523-792d-428b-a875-44720d519233 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:04.377480 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-da433523-792d-428b-a875-44720d519233 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:04.377961 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-da433523-792d-428b-a875-44720d519233 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:04.378393 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-da433523-792d-428b-a875-44720d519233 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:04.379097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-da433523-792d-428b-a875-44720d519233 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:04.379550 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-da433523-792d-428b-a875-44720d519233 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:04.379971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-da433523-792d-428b-a875-44720d519233 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:04.523961 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-da433523-792d-428b-a875-44720d519233 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:04.533331 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-da433523-792d-428b-a875-44720d519233 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1314 microversion: 2.1 time: 0.166806 Sep 09 13:16:04.533902 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 107/216] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:04 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:04.710564 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0935da80-e58f-471c-bbdd-a287b5b7add0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:04.714370 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0935da80-e58f-471c-bbdd-a287b5b7add0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:04.735250 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0935da80-e58f-471c-bbdd-a287b5b7add0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:04.738039 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0935da80-e58f-471c-bbdd-a287b5b7add0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:04.739343 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0935da80-e58f-471c-bbdd-a287b5b7add0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:04.741032 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0935da80-e58f-471c-bbdd-a287b5b7add0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:04.742995 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0935da80-e58f-471c-bbdd-a287b5b7add0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:04.743728 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0935da80-e58f-471c-bbdd-a287b5b7add0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:04.882072 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c347d139-0850-4601-b8b9-91b1c8f49fe4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:04.882890 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c347d139-0850-4601-b8b9-91b1c8f49fe4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:04.897121 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:04.905248 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c347d139-0850-4601-b8b9-91b1c8f49fe4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:04.908194 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c347d139-0850-4601-b8b9-91b1c8f49fe4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:04.908757 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c347d139-0850-4601-b8b9-91b1c8f49fe4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:04.909693 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c347d139-0850-4601-b8b9-91b1c8f49fe4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:04.911473 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c347d139-0850-4601-b8b9-91b1c8f49fe4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:04.912546 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c347d139-0850-4601-b8b9-91b1c8f49fe4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:04.970313 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0935da80-e58f-471c-bbdd-a287b5b7add0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:04.982431 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0935da80-e58f-471c-bbdd-a287b5b7add0 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1553 microversion: 2.1 time: 0.283415 Sep 09 13:16:04.983687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 110/217] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:04 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1553 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:05.129362 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c347d139-0850-4601-b8b9-91b1c8f49fe4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:05.138304 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c347d139-0850-4601-b8b9-91b1c8f49fe4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.259410 Sep 09 13:16:05.138922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 108/218] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:04 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:05.555753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b24a44fc-8b0a-482b-8bcc-22e75c4d6bdc tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:05.556366 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b24a44fc-8b0a-482b-8bcc-22e75c4d6bdc tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:05.562622 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b24a44fc-8b0a-482b-8bcc-22e75c4d6bdc tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:05.563134 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b24a44fc-8b0a-482b-8bcc-22e75c4d6bdc tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:05.563631 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b24a44fc-8b0a-482b-8bcc-22e75c4d6bdc tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:05.564334 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b24a44fc-8b0a-482b-8bcc-22e75c4d6bdc tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:05.564787 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b24a44fc-8b0a-482b-8bcc-22e75c4d6bdc tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:05.565206 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b24a44fc-8b0a-482b-8bcc-22e75c4d6bdc tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:05.704708 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b24a44fc-8b0a-482b-8bcc-22e75c4d6bdc tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:05.712382 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b24a44fc-8b0a-482b-8bcc-22e75c4d6bdc tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1314 microversion: 2.1 time: 0.160602 Sep 09 13:16:05.712963 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 111/219] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:05 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:06.015437 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cec9920e-1e7a-4740-9a43-fa02b3688a52 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:06.016064 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cec9920e-1e7a-4740-9a43-fa02b3688a52 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:06.022618 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cec9920e-1e7a-4740-9a43-fa02b3688a52 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:06.023136 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cec9920e-1e7a-4740-9a43-fa02b3688a52 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:06.027732 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cec9920e-1e7a-4740-9a43-fa02b3688a52 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:06.029196 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cec9920e-1e7a-4740-9a43-fa02b3688a52 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:06.029887 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cec9920e-1e7a-4740-9a43-fa02b3688a52 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:06.030325 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cec9920e-1e7a-4740-9a43-fa02b3688a52 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:06.163850 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ac3ec63-29ff-4bee-9387-e75d6ffd26ff tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:06.164468 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ac3ec63-29ff-4bee-9387-e75d6ffd26ff tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:06.175600 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac3ec63-29ff-4bee-9387-e75d6ffd26ff tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:06.176204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac3ec63-29ff-4bee-9387-e75d6ffd26ff tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:06.177046 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac3ec63-29ff-4bee-9387-e75d6ffd26ff tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:06.178082 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac3ec63-29ff-4bee-9387-e75d6ffd26ff tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:06.178883 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac3ec63-29ff-4bee-9387-e75d6ffd26ff tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:06.179430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ac3ec63-29ff-4bee-9387-e75d6ffd26ff tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:06.281652 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-cec9920e-1e7a-4740-9a43-fa02b3688a52 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:06.308706 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cec9920e-1e7a-4740-9a43-fa02b3688a52 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1553 microversion: 2.1 time: 0.298198 Sep 09 13:16:06.310164 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 109/220] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:06 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1553 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:06.395820 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2ac3ec63-29ff-4bee-9387-e75d6ffd26ff tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:06.406283 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ac3ec63-29ff-4bee-9387-e75d6ffd26ff tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.247511 Sep 09 13:16:06.406873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 112/221] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:06 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:06.735586 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-407bfbbf-d704-408b-af4c-1c0cc4da0fab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:06.736278 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-407bfbbf-d704-408b-af4c-1c0cc4da0fab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:06.742283 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-407bfbbf-d704-408b-af4c-1c0cc4da0fab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:06.742759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-407bfbbf-d704-408b-af4c-1c0cc4da0fab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:06.743329 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-407bfbbf-d704-408b-af4c-1c0cc4da0fab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:06.744160 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-407bfbbf-d704-408b-af4c-1c0cc4da0fab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:06.744450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-407bfbbf-d704-408b-af4c-1c0cc4da0fab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:06.744865 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-407bfbbf-d704-408b-af4c-1c0cc4da0fab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:06.922543 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-407bfbbf-d704-408b-af4c-1c0cc4da0fab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:06.933578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-407bfbbf-d704-408b-af4c-1c0cc4da0fab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1497 microversion: 2.1 time: 0.202480 Sep 09 13:16:06.934870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 110/222] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:06 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:07.337031 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f178cb9-f66d-46eb-ad9b-c9028ed65ddd tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:07.338318 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f178cb9-f66d-46eb-ad9b-c9028ed65ddd tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:07.345720 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f178cb9-f66d-46eb-ad9b-c9028ed65ddd tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:07.346443 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f178cb9-f66d-46eb-ad9b-c9028ed65ddd tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:07.346985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f178cb9-f66d-46eb-ad9b-c9028ed65ddd tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:07.348446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f178cb9-f66d-46eb-ad9b-c9028ed65ddd tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:07.349273 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f178cb9-f66d-46eb-ad9b-c9028ed65ddd tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:07.349792 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f178cb9-f66d-46eb-ad9b-c9028ed65ddd tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:07.428767 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5c1e6b80-b663-400e-9ba4-896ba434308f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:07.429424 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5c1e6b80-b663-400e-9ba4-896ba434308f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:07.438132 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5c1e6b80-b663-400e-9ba4-896ba434308f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:07.439120 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5c1e6b80-b663-400e-9ba4-896ba434308f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:07.439888 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5c1e6b80-b663-400e-9ba4-896ba434308f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:07.440916 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5c1e6b80-b663-400e-9ba4-896ba434308f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:07.441574 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5c1e6b80-b663-400e-9ba4-896ba434308f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:07.442144 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5c1e6b80-b663-400e-9ba4-896ba434308f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:07.539213 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f178cb9-f66d-46eb-ad9b-c9028ed65ddd tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:07.550401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f178cb9-f66d-46eb-ad9b-c9028ed65ddd tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1553 microversion: 2.1 time: 0.218595 Sep 09 13:16:07.551357 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 113/223] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:07 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:07.557597 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-417bcd2c-fcc0-428a-b9b7-969bfbfb10e4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:07.558344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-417bcd2c-fcc0-428a-b9b7-969bfbfb10e4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:07.566489 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-417bcd2c-fcc0-428a-b9b7-969bfbfb10e4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:07.567210 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-417bcd2c-fcc0-428a-b9b7-969bfbfb10e4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:07.567839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-417bcd2c-fcc0-428a-b9b7-969bfbfb10e4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:07.568741 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-417bcd2c-fcc0-428a-b9b7-969bfbfb10e4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:07.569397 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-417bcd2c-fcc0-428a-b9b7-969bfbfb10e4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:07.570701 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-417bcd2c-fcc0-428a-b9b7-969bfbfb10e4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:07.616084 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-417bcd2c-fcc0-428a-b9b7-969bfbfb10e4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:16:07.792486 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5c1e6b80-b663-400e-9ba4-896ba434308f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:07.805217 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5c1e6b80-b663-400e-9ba4-896ba434308f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.380343 Sep 09 13:16:07.806170 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 111/224] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:07 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:07.816389 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-e6affa6a-e6c4-4084-91a0-f2db5119dcfd req-a48a2de3-7b3c-4f13-a772-08d4c279f921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99000808-b419-4f81-b651-d9461adca1d7", "name": "network-vif-deleted", "tag": "62440413-4def-40fe-bb82-2e853fce3d70"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:07.843022 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e6affa6a-e6c4-4084-91a0-f2db5119dcfd req-a48a2de3-7b3c-4f13-a772-08d4c279f921 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:07.844857 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e6affa6a-e6c4-4084-91a0-f2db5119dcfd req-a48a2de3-7b3c-4f13-a772-08d4c279f921 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:07.845595 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e6affa6a-e6c4-4084-91a0-f2db5119dcfd req-a48a2de3-7b3c-4f13-a772-08d4c279f921 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:07.859613 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-417bcd2c-fcc0-428a-b9b7-969bfbfb10e4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "DELETE /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 204 len: 0 microversion: 2.1 time: 0.305795 Sep 09 13:16:07.860229 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 114/225] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:16:07 2022] DELETE /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:16:07.871222 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f7f45cf0-ed28-4a44-ab2d-b5b481c1a66c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:07.873685 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f7f45cf0-ed28-4a44-ab2d-b5b481c1a66c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:07.887554 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7f45cf0-ed28-4a44-ab2d-b5b481c1a66c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:07.888212 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7f45cf0-ed28-4a44-ab2d-b5b481c1a66c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:07.888826 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7f45cf0-ed28-4a44-ab2d-b5b481c1a66c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:07.889695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7f45cf0-ed28-4a44-ab2d-b5b481c1a66c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:07.890051 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-e6affa6a-e6c4-4084-91a0-f2db5119dcfd req-a48a2de3-7b3c-4f13-a772-08d4c279f921 service nova] Creating event network-vif-deleted:62440413-4def-40fe-bb82-2e853fce3d70 for instance 99000808-b419-4f81-b651-d9461adca1d7 on hv-cinder-83124 Sep 09 13:16:07.890470 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7f45cf0-ed28-4a44-ab2d-b5b481c1a66c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:07.891322 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7f45cf0-ed28-4a44-ab2d-b5b481c1a66c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:07.905548 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-e6affa6a-e6c4-4084-91a0-f2db5119dcfd req-a48a2de3-7b3c-4f13-a772-08d4c279f921 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096602 Sep 09 13:16:07.908545 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 112/226] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:16:08.117892 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f7f45cf0-ed28-4a44-ab2d-b5b481c1a66c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:08.127095 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f7f45cf0-ed28-4a44-ab2d-b5b481c1a66c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1503 microversion: 2.1 time: 0.259889 Sep 09 13:16:08.128226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 115/227] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:07 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:08.579014 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d3fa09a8-2bf0-4219-a91d-bd1d5609a919 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:08.579748 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d3fa09a8-2bf0-4219-a91d-bd1d5609a919 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:08.586119 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3fa09a8-2bf0-4219-a91d-bd1d5609a919 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:08.586602 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3fa09a8-2bf0-4219-a91d-bd1d5609a919 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:08.587028 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3fa09a8-2bf0-4219-a91d-bd1d5609a919 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:08.587796 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3fa09a8-2bf0-4219-a91d-bd1d5609a919 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:08.588216 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3fa09a8-2bf0-4219-a91d-bd1d5609a919 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:08.588655 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3fa09a8-2bf0-4219-a91d-bd1d5609a919 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:08.657553 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d3fa09a8-2bf0-4219-a91d-bd1d5609a919 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:08.665781 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d3fa09a8-2bf0-4219-a91d-bd1d5609a919 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1345 microversion: 2.1 time: 0.091653 Sep 09 13:16:08.666348 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 113/228] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:08 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:08.832282 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-86dccee6-b6a0-42d7-a0c3-0ed29f6c43a1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:08.832897 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-86dccee6-b6a0-42d7-a0c3-0ed29f6c43a1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:08.839330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86dccee6-b6a0-42d7-a0c3-0ed29f6c43a1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:08.839815 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86dccee6-b6a0-42d7-a0c3-0ed29f6c43a1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:08.840251 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86dccee6-b6a0-42d7-a0c3-0ed29f6c43a1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:08.841368 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86dccee6-b6a0-42d7-a0c3-0ed29f6c43a1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:08.841830 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86dccee6-b6a0-42d7-a0c3-0ed29f6c43a1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:08.842257 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86dccee6-b6a0-42d7-a0c3-0ed29f6c43a1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:08.977896 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-86dccee6-b6a0-42d7-a0c3-0ed29f6c43a1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:08.986609 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-86dccee6-b6a0-42d7-a0c3-0ed29f6c43a1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.158069 Sep 09 13:16:08.987195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 116/229] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:08 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:09.151102 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c7bd033e-a67f-4f5c-9121-b331f79fbda4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:09.151739 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c7bd033e-a67f-4f5c-9121-b331f79fbda4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:09.158325 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7bd033e-a67f-4f5c-9121-b331f79fbda4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:09.158807 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7bd033e-a67f-4f5c-9121-b331f79fbda4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:09.159283 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7bd033e-a67f-4f5c-9121-b331f79fbda4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:09.159974 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7bd033e-a67f-4f5c-9121-b331f79fbda4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:09.160429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7bd033e-a67f-4f5c-9121-b331f79fbda4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:09.160849 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c7bd033e-a67f-4f5c-9121-b331f79fbda4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:09.296006 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c7bd033e-a67f-4f5c-9121-b331f79fbda4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:09.303629 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c7bd033e-a67f-4f5c-9121-b331f79fbda4 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1503 microversion: 2.1 time: 0.156650 Sep 09 13:16:09.304190 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 114/230] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:09 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:09.688984 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6c5b36de-5800-49cf-a374-04d4588ac26e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:09.689592 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6c5b36de-5800-49cf-a374-04d4588ac26e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:09.691786 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:09.698506 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c5b36de-5800-49cf-a374-04d4588ac26e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:09.698506 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c5b36de-5800-49cf-a374-04d4588ac26e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:09.698506 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c5b36de-5800-49cf-a374-04d4588ac26e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:09.698750 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c5b36de-5800-49cf-a374-04d4588ac26e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:09.699028 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c5b36de-5800-49cf-a374-04d4588ac26e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:09.699476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c5b36de-5800-49cf-a374-04d4588ac26e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:09.704715 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:09.766592 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6c5b36de-5800-49cf-a374-04d4588ac26e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:09.774774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6c5b36de-5800-49cf-a374-04d4588ac26e tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1345 microversion: 2.1 time: 0.090177 Sep 09 13:16:09.775443 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 117/231] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:09 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:10.009620 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e3811e5c-6a75-4b21-8b4e-a6ae63dd7d6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:10.010257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e3811e5c-6a75-4b21-8b4e-a6ae63dd7d6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:10.016708 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3811e5c-6a75-4b21-8b4e-a6ae63dd7d6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:10.017197 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3811e5c-6a75-4b21-8b4e-a6ae63dd7d6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:10.017637 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3811e5c-6a75-4b21-8b4e-a6ae63dd7d6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:10.018325 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3811e5c-6a75-4b21-8b4e-a6ae63dd7d6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:10.018784 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3811e5c-6a75-4b21-8b4e-a6ae63dd7d6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:10.019257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e3811e5c-6a75-4b21-8b4e-a6ae63dd7d6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:10.171738 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e3811e5c-6a75-4b21-8b4e-a6ae63dd7d6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:10.179575 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e3811e5c-6a75-4b21-8b4e-a6ae63dd7d6a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.173749 Sep 09 13:16:10.180442 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 115/232] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:10 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:10.326716 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-462ca7e6-04a5-4095-8fe6-37ffd0e623d7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:10.327433 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-462ca7e6-04a5-4095-8fe6-37ffd0e623d7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:10.334135 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-462ca7e6-04a5-4095-8fe6-37ffd0e623d7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:10.334559 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-462ca7e6-04a5-4095-8fe6-37ffd0e623d7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:10.334988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-462ca7e6-04a5-4095-8fe6-37ffd0e623d7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:10.335726 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-462ca7e6-04a5-4095-8fe6-37ffd0e623d7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:10.336177 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-462ca7e6-04a5-4095-8fe6-37ffd0e623d7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:10.336594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-462ca7e6-04a5-4095-8fe6-37ffd0e623d7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:10.465194 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-462ca7e6-04a5-4095-8fe6-37ffd0e623d7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:10.472922 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-462ca7e6-04a5-4095-8fe6-37ffd0e623d7 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1503 microversion: 2.1 time: 0.150909 Sep 09 13:16:10.473489 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 118/233] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:10 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:10.796254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0cf2d729-642d-4265-98ba-9ac2369bd818 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:10.796862 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0cf2d729-642d-4265-98ba-9ac2369bd818 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:10.802741 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cf2d729-642d-4265-98ba-9ac2369bd818 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:10.803259 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cf2d729-642d-4265-98ba-9ac2369bd818 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:10.803694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cf2d729-642d-4265-98ba-9ac2369bd818 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:10.804372 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cf2d729-642d-4265-98ba-9ac2369bd818 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:10.804821 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cf2d729-642d-4265-98ba-9ac2369bd818 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:10.805253 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0cf2d729-642d-4265-98ba-9ac2369bd818 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:10.869985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0cf2d729-642d-4265-98ba-9ac2369bd818 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:10.878602 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0cf2d729-642d-4265-98ba-9ac2369bd818 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1345 microversion: 2.1 time: 0.086200 Sep 09 13:16:10.879197 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 116/234] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:10 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:11.209386 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3a0598cf-31ff-4ae7-a22d-0238da7a8629 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:11.210002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3a0598cf-31ff-4ae7-a22d-0238da7a8629 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:11.215898 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a0598cf-31ff-4ae7-a22d-0238da7a8629 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:11.216380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a0598cf-31ff-4ae7-a22d-0238da7a8629 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:11.216812 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a0598cf-31ff-4ae7-a22d-0238da7a8629 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:11.217501 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a0598cf-31ff-4ae7-a22d-0238da7a8629 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:11.217956 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a0598cf-31ff-4ae7-a22d-0238da7a8629 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:11.218377 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3a0598cf-31ff-4ae7-a22d-0238da7a8629 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:11.355486 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3a0598cf-31ff-4ae7-a22d-0238da7a8629 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:11.364966 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3a0598cf-31ff-4ae7-a22d-0238da7a8629 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.159278 Sep 09 13:16:11.365539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 119/235] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:11 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:11.496631 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cd130c54-ca53-4969-82b9-a440f69fa45a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:11.497774 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cd130c54-ca53-4969-82b9-a440f69fa45a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:11.504197 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd130c54-ca53-4969-82b9-a440f69fa45a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:11.504683 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd130c54-ca53-4969-82b9-a440f69fa45a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:11.505113 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd130c54-ca53-4969-82b9-a440f69fa45a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:11.505797 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd130c54-ca53-4969-82b9-a440f69fa45a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:11.506243 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd130c54-ca53-4969-82b9-a440f69fa45a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:11.506661 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cd130c54-ca53-4969-82b9-a440f69fa45a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:11.639025 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-cd130c54-ca53-4969-82b9-a440f69fa45a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:11.646872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cd130c54-ca53-4969-82b9-a440f69fa45a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1503 microversion: 2.1 time: 0.154335 Sep 09 13:16:11.647480 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 117/236] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:11 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:11.901642 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-882f59e0-1ce8-497b-a415-c97b5c08306b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:11.902573 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-882f59e0-1ce8-497b-a415-c97b5c08306b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:11.909770 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-882f59e0-1ce8-497b-a415-c97b5c08306b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:11.910297 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-882f59e0-1ce8-497b-a415-c97b5c08306b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:11.910739 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-882f59e0-1ce8-497b-a415-c97b5c08306b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:11.911475 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-882f59e0-1ce8-497b-a415-c97b5c08306b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:11.911934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-882f59e0-1ce8-497b-a415-c97b5c08306b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:11.912357 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-882f59e0-1ce8-497b-a415-c97b5c08306b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:11.945237 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-882f59e0-1ce8-497b-a415-c97b5c08306b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:11.945720 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-882f59e0-1ce8-497b-a415-c97b5c08306b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:11.946153 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-882f59e0-1ce8-497b-a415-c97b5c08306b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:11.946611 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-882f59e0-1ce8-497b-a415-c97b5c08306b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lazy-loading 'fault' on Instance uuid 99000808-b419-4f81-b651-d9461adca1d7 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:16:11.991295 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-882f59e0-1ce8-497b-a415-c97b5c08306b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efeb17c5a72b4e9294a63cf185737f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ecff6bf26f4cbeadb78b7272febb35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:11.999671 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-882f59e0-1ce8-497b-a415-c97b5c08306b tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 200 len: 1350 microversion: 2.1 time: 0.101815 Sep 09 13:16:12.000245 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 120/237] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:11 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:12.363490 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-ae20d3b3-ccee-4d8a-8c9d-ceebfb9a660c req-e784d235-72b8-43cd-8648-581dd82033c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972dd913-26df-4c31-bc52-20f28ce57749", "name": "network-vif-deleted", "tag": "02db944a-497e-4ba0-9f8b-7ad9adaf52b4"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:12.376153 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-ae20d3b3-ccee-4d8a-8c9d-ceebfb9a660c req-e784d235-72b8-43cd-8648-581dd82033c8 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:12.376929 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-ae20d3b3-ccee-4d8a-8c9d-ceebfb9a660c req-e784d235-72b8-43cd-8648-581dd82033c8 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:12.377797 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-ae20d3b3-ccee-4d8a-8c9d-ceebfb9a660c req-e784d235-72b8-43cd-8648-581dd82033c8 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:12.391397 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e3bdb9c-eb5c-4a44-b4e7-981a11037ef4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:12.392010 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e3bdb9c-eb5c-4a44-b4e7-981a11037ef4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:12.408759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-ae20d3b3-ccee-4d8a-8c9d-ceebfb9a660c req-e784d235-72b8-43cd-8648-581dd82033c8 service nova] Creating event network-vif-deleted:02db944a-497e-4ba0-9f8b-7ad9adaf52b4 for instance 972dd913-26df-4c31-bc52-20f28ce57749 on hv-cinder-83124 Sep 09 13:16:12.411763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e3bdb9c-eb5c-4a44-b4e7-981a11037ef4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:12.412461 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e3bdb9c-eb5c-4a44-b4e7-981a11037ef4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:12.412899 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e3bdb9c-eb5c-4a44-b4e7-981a11037ef4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:12.413614 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e3bdb9c-eb5c-4a44-b4e7-981a11037ef4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:12.414172 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e3bdb9c-eb5c-4a44-b4e7-981a11037ef4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:12.414595 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e3bdb9c-eb5c-4a44-b4e7-981a11037ef4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:12.425240 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-ae20d3b3-ccee-4d8a-8c9d-ceebfb9a660c req-e784d235-72b8-43cd-8648-581dd82033c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065519 Sep 09 13:16:12.426539 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 118/238] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:16:12.570072 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e3bdb9c-eb5c-4a44-b4e7-981a11037ef4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:12.579044 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e3bdb9c-eb5c-4a44-b4e7-981a11037ef4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.191744 Sep 09 13:16:12.579945 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 121/239] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:12 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:12.670560 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bf156a77-7f73-4a56-83d1-156e77cfbb87 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:12.671347 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bf156a77-7f73-4a56-83d1-156e77cfbb87 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:12.678179 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf156a77-7f73-4a56-83d1-156e77cfbb87 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:12.678910 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf156a77-7f73-4a56-83d1-156e77cfbb87 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:12.679427 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf156a77-7f73-4a56-83d1-156e77cfbb87 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:12.680241 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf156a77-7f73-4a56-83d1-156e77cfbb87 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:12.680792 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf156a77-7f73-4a56-83d1-156e77cfbb87 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:12.681265 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf156a77-7f73-4a56-83d1-156e77cfbb87 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:12.719778 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf156a77-7f73-4a56-83d1-156e77cfbb87 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:12.720311 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf156a77-7f73-4a56-83d1-156e77cfbb87 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:12.720751 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bf156a77-7f73-4a56-83d1-156e77cfbb87 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:12.721190 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-bf156a77-7f73-4a56-83d1-156e77cfbb87 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lazy-loading 'fault' on Instance uuid 972dd913-26df-4c31-bc52-20f28ce57749 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:16:12.771196 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bf156a77-7f73-4a56-83d1-156e77cfbb87 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:12.779280 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bf156a77-7f73-4a56-83d1-156e77cfbb87 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1304 microversion: 2.1 time: 0.113142 Sep 09 13:16:12.779851 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 119/240] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:12 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:13.023267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6592bb71-5d59-4f5b-8ffe-bd1cc0159879 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:13.023880 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6592bb71-5d59-4f5b-8ffe-bd1cc0159879 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:13.030197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6592bb71-5d59-4f5b-8ffe-bd1cc0159879 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:13.030677 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6592bb71-5d59-4f5b-8ffe-bd1cc0159879 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:13.031136 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6592bb71-5d59-4f5b-8ffe-bd1cc0159879 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:13.031831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6592bb71-5d59-4f5b-8ffe-bd1cc0159879 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:13.032284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6592bb71-5d59-4f5b-8ffe-bd1cc0159879 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:13.032710 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6592bb71-5d59-4f5b-8ffe-bd1cc0159879 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:13.046284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-6592bb71-5d59-4f5b-8ffe-bd1cc0159879 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] HTTP exception thrown: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6592bb71-5d59-4f5b-8ffe-bd1cc0159879 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Request method failure captured: Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 HTTP/1.1 Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzxHeWFGZF4_Bs014TsuySiTRKNaM4q7VpwkZHL7PBhQQCT88dTJTwxFWYPYhl6ysURQSTy8H-goSR16nJ9jcNaV95zr5ScaalpeC2IvSrZMvVSP6YlrQf8pgNCPzisGTGRJLYR6FXEbvQLFF5YvMZeqw9p-vSBrGHbI8MeAes10h3I Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 80ecff6bf26f4cbeadb78b7272febb35 Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-394080975 Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:16:13.050831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:16:13.052508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/80ecff6bf26f4cbeadb78b7272febb35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/80ecff6bf26f4cbeadb78b7272febb35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/80ecff6bf26f4cbeadb78b7272febb35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_80ecff6bf26f4cbeadb78b7272febb35", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:16:13.052508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-394080975 Sep 09 13:16:13.052508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 80ecff6bf26f4cbeadb78b7272febb35 Sep 09 13:16:13.052508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-394080975 Sep 09 13:16:13.052508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-394080975-project Sep 09 13:16:13.052508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:16:13.052508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:16:13.052508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: efeb17c5a72b4e9294a63cf185737f3f Sep 09 13:16:13.052508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-394080975-project Sep 09 13:16:13.052508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:16:13.052508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:13.052508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '99000808-b419-4f81-b651-d9461adca1d7'} Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:16:13.053643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:13.055418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:13.056852 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6592bb71-5d59-4f5b-8ffe-bd1cc0159879 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Returning 404 to user: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:16:13.056852 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6592bb71-5d59-4f5b-8ffe-bd1cc0159879 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 404 len: 111 microversion: 2.1 time: 0.032938 Sep 09 13:16:13.056852 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 122/241] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:13 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:16:13.166138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ea152dcb-45b0-4832-9c9e-aa39c32f6381 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:13.168343 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ea152dcb-45b0-4832-9c9e-aa39c32f6381 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:13.174299 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea152dcb-45b0-4832-9c9e-aa39c32f6381 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:13.174777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea152dcb-45b0-4832-9c9e-aa39c32f6381 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:13.175252 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea152dcb-45b0-4832-9c9e-aa39c32f6381 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:13.175929 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea152dcb-45b0-4832-9c9e-aa39c32f6381 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:13.176376 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea152dcb-45b0-4832-9c9e-aa39c32f6381 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:13.176794 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea152dcb-45b0-4832-9c9e-aa39c32f6381 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:13.189661 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-ea152dcb-45b0-4832-9c9e-aa39c32f6381 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] HTTP exception thrown: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ea152dcb-45b0-4832-9c9e-aa39c32f6381 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Request method failure captured: Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7/os-volume_attachments HTTP/1.1 Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxHeWFGZF4_Bs014TsuySiTRKNaM4q7VpwkZHL7PBhQQCT88dTJTwxFWYPYhl6ysURQSTy8H-goSR16nJ9jcNaV95zr5ScaalpeC2IvSrZMvVSP6YlrQf8pgNCPzisGTGRJLYR6FXEbvQLFF5YvMZeqw9p-vSBrGHbI8MeAes10h3I Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 80ecff6bf26f4cbeadb78b7272febb35 Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-DeleteServersTestJSON-394080975 Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:16:13.193827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:16:13.195254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/80ecff6bf26f4cbeadb78b7272febb35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/80ecff6bf26f4cbeadb78b7272febb35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/80ecff6bf26f4cbeadb78b7272febb35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_80ecff6bf26f4cbeadb78b7272febb35", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:16:13.195254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-DeleteServersTestJSON-394080975 Sep 09 13:16:13.195254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 80ecff6bf26f4cbeadb78b7272febb35 Sep 09 13:16:13.195254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-DeleteServersTestJSON-394080975 Sep 09 13:16:13.195254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-DeleteServersTestJSON-394080975-project Sep 09 13:16:13.195254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:16:13.195254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:16:13.195254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: efeb17c5a72b4e9294a63cf185737f3f Sep 09 13:16:13.195254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-DeleteServersTestJSON-394080975-project Sep 09 13:16:13.195254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:16:13.195254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:13.195254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'server_id': '99000808-b419-4f81-b651-d9461adca1d7'} Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:16:13.196150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:13.197555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:16:13.199297 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ea152dcb-45b0-4832-9c9e-aa39c32f6381 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Returning 404 to user: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:16:13.199297 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ea152dcb-45b0-4832-9c9e-aa39c32f6381 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033074 Sep 09 13:16:13.199297 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 120/242] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:16:13 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:16:13.604566 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-201151da-dec0-4ad5-ae99-641cbca7e511 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:13.605182 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-201151da-dec0-4ad5-ae99-641cbca7e511 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:13.611885 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-201151da-dec0-4ad5-ae99-641cbca7e511 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:13.612322 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-201151da-dec0-4ad5-ae99-641cbca7e511 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:13.612756 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-201151da-dec0-4ad5-ae99-641cbca7e511 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:13.613472 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-201151da-dec0-4ad5-ae99-641cbca7e511 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:13.614180 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-201151da-dec0-4ad5-ae99-641cbca7e511 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:13.614604 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-201151da-dec0-4ad5-ae99-641cbca7e511 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:13.753247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-201151da-dec0-4ad5-ae99-641cbca7e511 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:13.763654 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-201151da-dec0-4ad5-ae99-641cbca7e511 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.162890 Sep 09 13:16:13.764497 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 123/243] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:13 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:13.802891 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-eb92ac28-d26a-441f-b740-f714e68a6276 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:13.803551 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-eb92ac28-d26a-441f-b740-f714e68a6276 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:13.809941 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb92ac28-d26a-441f-b740-f714e68a6276 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:13.810442 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb92ac28-d26a-441f-b740-f714e68a6276 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:13.810862 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb92ac28-d26a-441f-b740-f714e68a6276 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:13.811586 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb92ac28-d26a-441f-b740-f714e68a6276 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:13.812044 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb92ac28-d26a-441f-b740-f714e68a6276 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:13.812471 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb92ac28-d26a-441f-b740-f714e68a6276 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:13.816631 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:13.844452 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb92ac28-d26a-441f-b740-f714e68a6276 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:13.844810 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb92ac28-d26a-441f-b740-f714e68a6276 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:13.845255 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb92ac28-d26a-441f-b740-f714e68a6276 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:13.845700 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-eb92ac28-d26a-441f-b740-f714e68a6276 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lazy-loading 'fault' on Instance uuid 972dd913-26df-4c31-bc52-20f28ce57749 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:16:13.886825 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-eb92ac28-d26a-441f-b740-f714e68a6276 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:13.895204 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-eb92ac28-d26a-441f-b740-f714e68a6276 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1304 microversion: 2.1 time: 0.096066 Sep 09 13:16:13.895769 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 121/244] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:13 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:14.787333 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d68edc01-6449-4031-ba6b-6b183f07879f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:14.788358 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d68edc01-6449-4031-ba6b-6b183f07879f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:14.795018 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d68edc01-6449-4031-ba6b-6b183f07879f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:14.795534 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d68edc01-6449-4031-ba6b-6b183f07879f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:14.795965 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d68edc01-6449-4031-ba6b-6b183f07879f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:14.796657 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d68edc01-6449-4031-ba6b-6b183f07879f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:14.797109 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d68edc01-6449-4031-ba6b-6b183f07879f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:14.797532 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d68edc01-6449-4031-ba6b-6b183f07879f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:14.917705 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-047e01df-fa23-402b-ae2d-364832b976a2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:14.918326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-047e01df-fa23-402b-ae2d-364832b976a2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:14.924274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d68edc01-6449-4031-ba6b-6b183f07879f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:14.925163 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-047e01df-fa23-402b-ae2d-364832b976a2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:14.925659 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-047e01df-fa23-402b-ae2d-364832b976a2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:14.926098 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-047e01df-fa23-402b-ae2d-364832b976a2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:14.926800 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-047e01df-fa23-402b-ae2d-364832b976a2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:14.927282 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-047e01df-fa23-402b-ae2d-364832b976a2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:14.927708 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-047e01df-fa23-402b-ae2d-364832b976a2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:14.931993 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d68edc01-6449-4031-ba6b-6b183f07879f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.148636 Sep 09 13:16:14.932560 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 124/245] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:14 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:14.958515 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-047e01df-fa23-402b-ae2d-364832b976a2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:14.958989 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-047e01df-fa23-402b-ae2d-364832b976a2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:14.959453 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-047e01df-fa23-402b-ae2d-364832b976a2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:14.959892 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-047e01df-fa23-402b-ae2d-364832b976a2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lazy-loading 'fault' on Instance uuid 972dd913-26df-4c31-bc52-20f28ce57749 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:16:15.000553 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-047e01df-fa23-402b-ae2d-364832b976a2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:15.008085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-047e01df-fa23-402b-ae2d-364832b976a2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 200 len: 1304 microversion: 2.1 time: 0.094241 Sep 09 13:16:15.008737 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 122/246] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:14 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:15.955307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aa16eab9-0355-4bc9-94c4-64a694f677ed tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:15.956338 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aa16eab9-0355-4bc9-94c4-64a694f677ed tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:15.962480 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa16eab9-0355-4bc9-94c4-64a694f677ed tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:15.962981 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa16eab9-0355-4bc9-94c4-64a694f677ed tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:15.963430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa16eab9-0355-4bc9-94c4-64a694f677ed tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:15.964122 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa16eab9-0355-4bc9-94c4-64a694f677ed tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:15.964596 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa16eab9-0355-4bc9-94c4-64a694f677ed tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:15.965017 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aa16eab9-0355-4bc9-94c4-64a694f677ed tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:16.032533 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ff23f94f-38d0-4ec3-8a89-21a907399d26 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:16.034141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ff23f94f-38d0-4ec3-8a89-21a907399d26 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 972dd913-26df-4c31-bc52-20f28ce57749] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:16.041049 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff23f94f-38d0-4ec3-8a89-21a907399d26 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:16.041489 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff23f94f-38d0-4ec3-8a89-21a907399d26 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:16.042086 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff23f94f-38d0-4ec3-8a89-21a907399d26 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:16.042843 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff23f94f-38d0-4ec3-8a89-21a907399d26 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:16.043373 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff23f94f-38d0-4ec3-8a89-21a907399d26 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:16.045527 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff23f94f-38d0-4ec3-8a89-21a907399d26 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:16.064550 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-ff23f94f-38d0-4ec3-8a89-21a907399d26 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] HTTP exception thrown: Instance 972dd913-26df-4c31-bc52-20f28ce57749 could not be found. Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ff23f94f-38d0-4ec3-8a89-21a907399d26 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Request method failure captured: Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 HTTP/1.1 Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzx8RNwDPOM0hMIkkH53JmuZ5UzlrWe9mluR1Dtul5kFujY4hk9yDxL4TIfkNF_dVcQNcYQ3bcg25blhf3zW8LhhlHf-wsA1acQcmA1x8JtBZub35yrU2T078NXexrdcND82B24a_outch8iQuPbIFKYhzUhiUR_PABajtXiFpu44j4 Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: ca38013a20eb4c8e830e391cc06f485f Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-VolumesActionsTest-1440914682 Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:16:16.067289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:16:16.069295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ca38013a20eb4c8e830e391cc06f485f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ca38013a20eb4c8e830e391cc06f485f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ca38013a20eb4c8e830e391cc06f485f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ca38013a20eb4c8e830e391cc06f485f", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:16:16.069295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-VolumesActionsTest-1440914682 Sep 09 13:16:16.069295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: ca38013a20eb4c8e830e391cc06f485f Sep 09 13:16:16.069295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-VolumesActionsTest-1440914682 Sep 09 13:16:16.069295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-VolumesActionsTest-1440914682-project Sep 09 13:16:16.069295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:16:16.069295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:16:16.069295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: d73fdae39484489facaf6831430cd4d7 Sep 09 13:16:16.069295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-VolumesActionsTest-1440914682-project Sep 09 13:16:16.069295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:16:16.069295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance 972dd913-26df-4c31-bc52-20f28ce57749 could not be found. Sep 09 13:16:16.069295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '972dd913-26df-4c31-bc52-20f28ce57749'} Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972dd913-26df-4c31-bc52-20f28ce57749 could not be found. Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:16:16.071081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972dd913-26df-4c31-bc52-20f28ce57749 could not be found. Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972dd913-26df-4c31-bc52-20f28ce57749 could not be found. Sep 09 13:16:16.072364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.073528 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ff23f94f-38d0-4ec3-8a89-21a907399d26 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Returning 404 to user: Instance 972dd913-26df-4c31-bc52-20f28ce57749 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:16:16.073528 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ff23f94f-38d0-4ec3-8a89-21a907399d26 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749" status: 404 len: 111 microversion: 2.1 time: 0.042821 Sep 09 13:16:16.073528 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 123/247] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:16 2022] GET /compute/v2.1/servers/972dd913-26df-4c31-bc52-20f28ce57749 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:16:16.141032 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-aa16eab9-0355-4bc9-94c4-64a694f677ed tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:16.156656 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aa16eab9-0355-4bc9-94c4-64a694f677ed tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.205236 Sep 09 13:16:16.157562 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 125/248] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:15 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:16.193170 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1644119316", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "networks": [{"uuid": "d12fe7e1-f7e0-4794-b29e-ff4e5939d9bc"}]}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:16.249234 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] validate_networks() for [('d12fe7e1-f7e0-4794-b29e-ff4e5939d9bc', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:16:16.509407 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e0fbcaa-4858-4d56-81fd-9db362eaefe6 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:16.509902 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e0fbcaa-4858-4d56-81fd-9db362eaefe6 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:16.516287 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e0fbcaa-4858-4d56-81fd-9db362eaefe6 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:16.516770 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e0fbcaa-4858-4d56-81fd-9db362eaefe6 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:16.517201 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e0fbcaa-4858-4d56-81fd-9db362eaefe6 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:16.517958 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e0fbcaa-4858-4d56-81fd-9db362eaefe6 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:16.518416 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e0fbcaa-4858-4d56-81fd-9db362eaefe6 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:16.518838 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e0fbcaa-4858-4d56-81fd-9db362eaefe6 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:16.532519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-0e0fbcaa-4858-4d56-81fd-9db362eaefe6 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] HTTP exception thrown: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e0fbcaa-4858-4d56-81fd-9db362eaefe6 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Request method failure captured: Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 HTTP/1.1 Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzxHeWFGZF4_Bs014TsuySiTRKNaM4q7VpwkZHL7PBhQQCT88dTJTwxFWYPYhl6ysURQSTy8H-goSR16nJ9jcNaV95zr5ScaalpeC2IvSrZMvVSP6YlrQf8pgNCPzisGTGRJLYR6FXEbvQLFF5YvMZeqw9p-vSBrGHbI8MeAes10h3I Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 80ecff6bf26f4cbeadb78b7272febb35 Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-394080975 Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:16:16.534068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:16:16.535430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/80ecff6bf26f4cbeadb78b7272febb35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/80ecff6bf26f4cbeadb78b7272febb35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/80ecff6bf26f4cbeadb78b7272febb35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_80ecff6bf26f4cbeadb78b7272febb35", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:16:16.535430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-394080975 Sep 09 13:16:16.535430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 80ecff6bf26f4cbeadb78b7272febb35 Sep 09 13:16:16.535430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-394080975 Sep 09 13:16:16.535430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-394080975-project Sep 09 13:16:16.535430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:16:16.535430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:16:16.535430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: efeb17c5a72b4e9294a63cf185737f3f Sep 09 13:16:16.535430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-394080975-project Sep 09 13:16:16.535430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:16:16.535430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:16.535430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '99000808-b419-4f81-b651-d9461adca1d7'} Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:16:16.536247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:16.537585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.538910 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e0fbcaa-4858-4d56-81fd-9db362eaefe6 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Returning 404 to user: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:16:16.538910 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e0fbcaa-4858-4d56-81fd-9db362eaefe6 tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "DELETE /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 404 len: 111 microversion: 2.1 time: 0.029828 Sep 09 13:16:16.539145 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 126/249] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:16:16 2022] DELETE /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 13:16:16.544184 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f6abcad3-321d-42ba-a757-5184943a6ceb tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:16.544962 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f6abcad3-321d-42ba-a757-5184943a6ceb tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] [instance: 99000808-b419-4f81-b651-d9461adca1d7] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:16.550654 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6abcad3-321d-42ba-a757-5184943a6ceb tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:16.551171 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6abcad3-321d-42ba-a757-5184943a6ceb tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:16.551605 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6abcad3-321d-42ba-a757-5184943a6ceb tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:16.552287 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6abcad3-321d-42ba-a757-5184943a6ceb tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:16.552740 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6abcad3-321d-42ba-a757-5184943a6ceb tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:16.553156 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6abcad3-321d-42ba-a757-5184943a6ceb tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:16.566960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-f6abcad3-321d-42ba-a757-5184943a6ceb tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] HTTP exception thrown: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f6abcad3-321d-42ba-a757-5184943a6ceb tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Request method failure captured: Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 HTTP/1.1 Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzxHeWFGZF4_Bs014TsuySiTRKNaM4q7VpwkZHL7PBhQQCT88dTJTwxFWYPYhl6ysURQSTy8H-goSR16nJ9jcNaV95zr5ScaalpeC2IvSrZMvVSP6YlrQf8pgNCPzisGTGRJLYR6FXEbvQLFF5YvMZeqw9p-vSBrGHbI8MeAes10h3I Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 80ecff6bf26f4cbeadb78b7272febb35 Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-DeleteServersTestJSON-394080975 Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:16:16.568766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:16:16.570127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/80ecff6bf26f4cbeadb78b7272febb35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/80ecff6bf26f4cbeadb78b7272febb35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/80ecff6bf26f4cbeadb78b7272febb35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_80ecff6bf26f4cbeadb78b7272febb35", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:16:16.570127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-DeleteServersTestJSON-394080975 Sep 09 13:16:16.570127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 80ecff6bf26f4cbeadb78b7272febb35 Sep 09 13:16:16.570127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-DeleteServersTestJSON-394080975 Sep 09 13:16:16.570127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-DeleteServersTestJSON-394080975-project Sep 09 13:16:16.570127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:16:16.570127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:16:16.570127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: efeb17c5a72b4e9294a63cf185737f3f Sep 09 13:16:16.570127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-DeleteServersTestJSON-394080975-project Sep 09 13:16:16.570127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:16:16.570127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:16.570127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '99000808-b419-4f81-b651-d9461adca1d7'} Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:16:16.570802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. Sep 09 13:16:16.571935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:16.572940 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f6abcad3-321d-42ba-a757-5184943a6ceb tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] Returning 404 to user: Instance 99000808-b419-4f81-b651-d9461adca1d7 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:16:16.572940 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f6abcad3-321d-42ba-a757-5184943a6ceb tempest-DeleteServersTestJSON-394080975 tempest-DeleteServersTestJSON-394080975-project] 10.222.0.17 "GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7" status: 404 len: 111 microversion: 2.1 time: 0.030009 Sep 09 13:16:16.572940 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 127/250] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:16 2022] GET /compute/v2.1/servers/99000808-b419-4f81-b651-d9461adca1d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:16:16.625427 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:16:16.625863 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:16:16.626336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:16:16.626743 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:16:16.627188 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:16:16.636393 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:16.637094 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:16.637562 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:16.638353 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:16.638811 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:16.639267 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:16.656305 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Getting quotas for project ca38013a20eb4c8e830e391cc06f485f. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:16:16.660325 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Getting quotas for user d73fdae39484489facaf6831430cd4d7 and project ca38013a20eb4c8e830e391cc06f485f. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:16:16.673833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:16:16.676941 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:16:16.748462 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-442e153d-eaab-4ecc-b9a6-cd06bfd28304 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558840 Sep 09 13:16:16.749179 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 124/251] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:16:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:16:16.760002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-35ef8958-6a4f-456f-990a-f9d1d69f4ecd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:16.760624 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-35ef8958-6a4f-456f-990a-f9d1d69f4ecd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:16.838391 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-35ef8958-6a4f-456f-990a-f9d1d69f4ecd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:16.847381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-35ef8958-6a4f-456f-990a-f9d1d69f4ecd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1214 microversion: 2.1 time: 0.090680 Sep 09 13:16:16.848280 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 128/252] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:16 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:17.183212 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-492c519c-3a64-48e3-81d4-4bd01db901a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:17.183854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-492c519c-3a64-48e3-81d4-4bd01db901a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:17.195719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-492c519c-3a64-48e3-81d4-4bd01db901a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:17.197549 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-492c519c-3a64-48e3-81d4-4bd01db901a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:17.198616 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-492c519c-3a64-48e3-81d4-4bd01db901a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:17.201869 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-492c519c-3a64-48e3-81d4-4bd01db901a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:17.206766 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-492c519c-3a64-48e3-81d4-4bd01db901a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:17.207497 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-492c519c-3a64-48e3-81d4-4bd01db901a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:17.391698 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-492c519c-3a64-48e3-81d4-4bd01db901a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:17.399554 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-492c519c-3a64-48e3-81d4-4bd01db901a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.220284 Sep 09 13:16:17.400123 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 125/253] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:17 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:17.872845 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b6e8786-b1ac-4058-9162-68369c45828a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:17.874894 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2b6e8786-b1ac-4058-9162-68369c45828a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:17.885395 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b6e8786-b1ac-4058-9162-68369c45828a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:17.886033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b6e8786-b1ac-4058-9162-68369c45828a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:17.886545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b6e8786-b1ac-4058-9162-68369c45828a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:17.887927 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b6e8786-b1ac-4058-9162-68369c45828a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:17.888766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b6e8786-b1ac-4058-9162-68369c45828a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:17.889255 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b6e8786-b1ac-4058-9162-68369c45828a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:17.967558 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2b6e8786-b1ac-4058-9162-68369c45828a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:17.978882 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b6e8786-b1ac-4058-9162-68369c45828a tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1266 microversion: 2.1 time: 0.112278 Sep 09 13:16:17.979526 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 129/254] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:17 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:18.423512 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1ac44f86-ee9e-495c-b7e6-966d40835342 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:18.433998 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1ac44f86-ee9e-495c-b7e6-966d40835342 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:18.441447 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ac44f86-ee9e-495c-b7e6-966d40835342 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:18.441941 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ac44f86-ee9e-495c-b7e6-966d40835342 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:18.442388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ac44f86-ee9e-495c-b7e6-966d40835342 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:18.443151 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ac44f86-ee9e-495c-b7e6-966d40835342 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:18.443552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ac44f86-ee9e-495c-b7e6-966d40835342 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:18.443975 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ac44f86-ee9e-495c-b7e6-966d40835342 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:18.715658 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1ac44f86-ee9e-495c-b7e6-966d40835342 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:18.741753 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1ac44f86-ee9e-495c-b7e6-966d40835342 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.304774 Sep 09 13:16:18.757588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 126/255] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:18 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:19.003891 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea9587b4-0a15-41d9-9958-f4bda21ebdab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:19.004472 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ea9587b4-0a15-41d9-9958-f4bda21ebdab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:19.017610 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea9587b4-0a15-41d9-9958-f4bda21ebdab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:19.018310 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea9587b4-0a15-41d9-9958-f4bda21ebdab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:19.018651 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea9587b4-0a15-41d9-9958-f4bda21ebdab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:19.019403 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea9587b4-0a15-41d9-9958-f4bda21ebdab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:19.019859 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea9587b4-0a15-41d9-9958-f4bda21ebdab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:19.023239 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea9587b4-0a15-41d9-9958-f4bda21ebdab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:19.131909 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ea9587b4-0a15-41d9-9958-f4bda21ebdab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:19.147923 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea9587b4-0a15-41d9-9958-f4bda21ebdab tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1272 microversion: 2.1 time: 0.147806 Sep 09 13:16:19.163508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 130/256] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:18 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:19.766606 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c43af619-2241-4281-b166-6631aec2f5fc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:19.768149 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c43af619-2241-4281-b166-6631aec2f5fc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:19.774902 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c43af619-2241-4281-b166-6631aec2f5fc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:19.775508 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c43af619-2241-4281-b166-6631aec2f5fc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:19.776016 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c43af619-2241-4281-b166-6631aec2f5fc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:19.776825 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c43af619-2241-4281-b166-6631aec2f5fc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:19.777349 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c43af619-2241-4281-b166-6631aec2f5fc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:19.778242 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c43af619-2241-4281-b166-6631aec2f5fc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:20.101535 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c43af619-2241-4281-b166-6631aec2f5fc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:20.110890 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c43af619-2241-4281-b166-6631aec2f5fc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.348895 Sep 09 13:16:20.133378 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 127/257] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:19 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:20.179604 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f69c1e5a-6cc7-477b-aac4-3e2a02822249 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:20.180762 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f69c1e5a-6cc7-477b-aac4-3e2a02822249 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:20.191278 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f69c1e5a-6cc7-477b-aac4-3e2a02822249 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:20.195199 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f69c1e5a-6cc7-477b-aac4-3e2a02822249 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:20.196168 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f69c1e5a-6cc7-477b-aac4-3e2a02822249 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:20.197101 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f69c1e5a-6cc7-477b-aac4-3e2a02822249 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:20.200685 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f69c1e5a-6cc7-477b-aac4-3e2a02822249 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:20.201371 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f69c1e5a-6cc7-477b-aac4-3e2a02822249 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:20.469398 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-cd793fb3-9e2e-40cb-b8aa-c9df54cbec74 req-a4d12d7b-c095-4666-b404-08ab4501430c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b", "tag": "058b7f82-d7de-4f52-af06-01f11adca191"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:20.480394 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-cd793fb3-9e2e-40cb-b8aa-c9df54cbec74 req-a4d12d7b-c095-4666-b404-08ab4501430c service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:20.481930 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-cd793fb3-9e2e-40cb-b8aa-c9df54cbec74 req-a4d12d7b-c095-4666-b404-08ab4501430c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:20.482746 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-cd793fb3-9e2e-40cb-b8aa-c9df54cbec74 req-a4d12d7b-c095-4666-b404-08ab4501430c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:20.495026 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-cd793fb3-9e2e-40cb-b8aa-c9df54cbec74 req-a4d12d7b-c095-4666-b404-08ab4501430c service nova] Creating event network-changed:058b7f82-d7de-4f52-af06-01f11adca191 for instance 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b on hv-cinder-83124 Sep 09 13:16:20.501681 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-cd793fb3-9e2e-40cb-b8aa-c9df54cbec74 req-a4d12d7b-c095-4666-b404-08ab4501430c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036050 Sep 09 13:16:20.502850 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 128/258] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:16:20.642564 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f69c1e5a-6cc7-477b-aac4-3e2a02822249 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:20.652429 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f69c1e5a-6cc7-477b-aac4-3e2a02822249 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1314 microversion: 2.1 time: 0.476912 Sep 09 13:16:20.653516 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 131/259] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:20 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:21.141514 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b9e6f256-531c-449e-9e75-f4c32b8290c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:21.142247 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b9e6f256-531c-449e-9e75-f4c32b8290c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:21.148878 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9e6f256-531c-449e-9e75-f4c32b8290c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:21.149360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9e6f256-531c-449e-9e75-f4c32b8290c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:21.149788 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9e6f256-531c-449e-9e75-f4c32b8290c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:21.150657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9e6f256-531c-449e-9e75-f4c32b8290c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:21.151135 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9e6f256-531c-449e-9e75-f4c32b8290c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:21.151580 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b9e6f256-531c-449e-9e75-f4c32b8290c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:21.295438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b9e6f256-531c-449e-9e75-f4c32b8290c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:21.303731 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b9e6f256-531c-449e-9e75-f4c32b8290c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.166940 Sep 09 13:16:21.304796 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 129/260] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:21 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:21.678577 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-390f7a4a-f5f4-4e1f-95df-d9fd63359a3d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:21.679824 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-390f7a4a-f5f4-4e1f-95df-d9fd63359a3d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:21.686612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-390f7a4a-f5f4-4e1f-95df-d9fd63359a3d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:21.687632 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-390f7a4a-f5f4-4e1f-95df-d9fd63359a3d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:21.688083 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-390f7a4a-f5f4-4e1f-95df-d9fd63359a3d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:21.689079 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-390f7a4a-f5f4-4e1f-95df-d9fd63359a3d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:21.689534 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-390f7a4a-f5f4-4e1f-95df-d9fd63359a3d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:21.690143 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-390f7a4a-f5f4-4e1f-95df-d9fd63359a3d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:21.850689 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-390f7a4a-f5f4-4e1f-95df-d9fd63359a3d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:21.866359 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-390f7a4a-f5f4-4e1f-95df-d9fd63359a3d tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1314 microversion: 2.1 time: 0.190096 Sep 09 13:16:21.866359 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 132/261] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:21 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:22.328496 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0b62e886-a430-4831-9a24-cfaef978105c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:22.329186 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0b62e886-a430-4831-9a24-cfaef978105c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:22.336604 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0b62e886-a430-4831-9a24-cfaef978105c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:22.337092 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0b62e886-a430-4831-9a24-cfaef978105c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:22.339748 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0b62e886-a430-4831-9a24-cfaef978105c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:22.341765 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0b62e886-a430-4831-9a24-cfaef978105c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:22.342241 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0b62e886-a430-4831-9a24-cfaef978105c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:22.343456 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0b62e886-a430-4831-9a24-cfaef978105c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:22.508653 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0b62e886-a430-4831-9a24-cfaef978105c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:22.516902 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0b62e886-a430-4831-9a24-cfaef978105c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.193300 Sep 09 13:16:22.518015 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 130/262] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:22 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:22.886774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-97962640-cc8b-4265-a99a-87735279c631 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:22.886774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-97962640-cc8b-4265-a99a-87735279c631 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:22.896576 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97962640-cc8b-4265-a99a-87735279c631 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:22.897078 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97962640-cc8b-4265-a99a-87735279c631 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:22.897519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97962640-cc8b-4265-a99a-87735279c631 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:22.903825 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97962640-cc8b-4265-a99a-87735279c631 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:22.904617 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97962640-cc8b-4265-a99a-87735279c631 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:22.905353 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-97962640-cc8b-4265-a99a-87735279c631 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:23.195353 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-97962640-cc8b-4265-a99a-87735279c631 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:23.205263 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-97962640-cc8b-4265-a99a-87735279c631 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1314 microversion: 2.1 time: 0.323364 Sep 09 13:16:23.206302 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 133/263] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:22 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:23.540842 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1fa66d31-12cf-414b-a714-4655e8447490 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:23.541369 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1fa66d31-12cf-414b-a714-4655e8447490 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:23.567494 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1fa66d31-12cf-414b-a714-4655e8447490 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:23.567494 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1fa66d31-12cf-414b-a714-4655e8447490 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:23.567494 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1fa66d31-12cf-414b-a714-4655e8447490 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:23.567494 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1fa66d31-12cf-414b-a714-4655e8447490 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:23.568020 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1fa66d31-12cf-414b-a714-4655e8447490 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:23.568020 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1fa66d31-12cf-414b-a714-4655e8447490 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:23.797665 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1fa66d31-12cf-414b-a714-4655e8447490 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:23.809313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1fa66d31-12cf-414b-a714-4655e8447490 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.272194 Sep 09 13:16:23.811600 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 131/264] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:23 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:24.229819 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-75d72b3b-61c4-47f0-ae90-5c93c1a293e6 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:24.231977 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-75d72b3b-61c4-47f0-ae90-5c93c1a293e6 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:24.239716 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75d72b3b-61c4-47f0-ae90-5c93c1a293e6 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:24.240193 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75d72b3b-61c4-47f0-ae90-5c93c1a293e6 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:24.240934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75d72b3b-61c4-47f0-ae90-5c93c1a293e6 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:24.241630 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75d72b3b-61c4-47f0-ae90-5c93c1a293e6 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:24.242079 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75d72b3b-61c4-47f0-ae90-5c93c1a293e6 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:24.242490 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75d72b3b-61c4-47f0-ae90-5c93c1a293e6 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:24.414903 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-75d72b3b-61c4-47f0-ae90-5c93c1a293e6 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:24.427564 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-75d72b3b-61c4-47f0-ae90-5c93c1a293e6 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1314 microversion: 2.1 time: 0.201977 Sep 09 13:16:24.429010 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 134/265] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:24 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:24.834342 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b2a339ea-454e-4cce-81a6-da04a5690ced tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:24.839106 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b2a339ea-454e-4cce-81a6-da04a5690ced tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:24.849820 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2a339ea-454e-4cce-81a6-da04a5690ced tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:24.850314 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2a339ea-454e-4cce-81a6-da04a5690ced tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:24.850834 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2a339ea-454e-4cce-81a6-da04a5690ced tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:24.851553 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2a339ea-454e-4cce-81a6-da04a5690ced tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:24.852216 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2a339ea-454e-4cce-81a6-da04a5690ced tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:24.852786 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2a339ea-454e-4cce-81a6-da04a5690ced tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:25.251912 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b2a339ea-454e-4cce-81a6-da04a5690ced tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:25.260350 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b2a339ea-454e-4cce-81a6-da04a5690ced tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.430318 Sep 09 13:16:25.260922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 132/266] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:24 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:25.455344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-27c751ef-15ee-4d8d-8e78-b55ea3391bdd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:25.456714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-27c751ef-15ee-4d8d-8e78-b55ea3391bdd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:25.469909 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c751ef-15ee-4d8d-8e78-b55ea3391bdd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:25.470792 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c751ef-15ee-4d8d-8e78-b55ea3391bdd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:25.472188 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c751ef-15ee-4d8d-8e78-b55ea3391bdd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:25.473282 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c751ef-15ee-4d8d-8e78-b55ea3391bdd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:25.474006 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c751ef-15ee-4d8d-8e78-b55ea3391bdd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:25.474706 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27c751ef-15ee-4d8d-8e78-b55ea3391bdd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:25.670943 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-27c751ef-15ee-4d8d-8e78-b55ea3391bdd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:25.685837 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-27c751ef-15ee-4d8d-8e78-b55ea3391bdd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1314 microversion: 2.1 time: 0.236004 Sep 09 13:16:25.687399 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 135/267] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:25 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:26.283927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e4a8fc46-8b43-4b39-aefb-fded6d6483a3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:26.284522 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e4a8fc46-8b43-4b39-aefb-fded6d6483a3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:26.293126 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4a8fc46-8b43-4b39-aefb-fded6d6483a3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:26.294341 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4a8fc46-8b43-4b39-aefb-fded6d6483a3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:26.294870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4a8fc46-8b43-4b39-aefb-fded6d6483a3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:26.306498 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4a8fc46-8b43-4b39-aefb-fded6d6483a3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:26.307311 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4a8fc46-8b43-4b39-aefb-fded6d6483a3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:26.307908 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4a8fc46-8b43-4b39-aefb-fded6d6483a3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:26.586886 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e4a8fc46-8b43-4b39-aefb-fded6d6483a3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:26.596890 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e4a8fc46-8b43-4b39-aefb-fded6d6483a3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.315297 Sep 09 13:16:26.597754 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 133/268] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:26 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:26.710483 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-10020611-6454-470e-990b-57ae9e42afbd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:26.711679 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-10020611-6454-470e-990b-57ae9e42afbd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:26.724392 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10020611-6454-470e-990b-57ae9e42afbd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:26.725140 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10020611-6454-470e-990b-57ae9e42afbd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:26.725752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10020611-6454-470e-990b-57ae9e42afbd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:26.726619 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10020611-6454-470e-990b-57ae9e42afbd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:26.727314 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10020611-6454-470e-990b-57ae9e42afbd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:26.728292 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10020611-6454-470e-990b-57ae9e42afbd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:26.766177 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:26.844627 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:27.219033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-10020611-6454-470e-990b-57ae9e42afbd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:27.227223 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-10020611-6454-470e-990b-57ae9e42afbd tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1314 microversion: 2.1 time: 0.521866 Sep 09 13:16:27.243341 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 136/269] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:26 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:27.624252 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-80f75809-d159-45a9-9fad-c03c902d1e1c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:27.625028 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-80f75809-d159-45a9-9fad-c03c902d1e1c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:27.627073 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:27.627897 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=6 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:27.638503 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80f75809-d159-45a9-9fad-c03c902d1e1c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:27.639009 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80f75809-d159-45a9-9fad-c03c902d1e1c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:27.639482 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80f75809-d159-45a9-9fad-c03c902d1e1c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:27.640189 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80f75809-d159-45a9-9fad-c03c902d1e1c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:27.642111 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80f75809-d159-45a9-9fad-c03c902d1e1c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:27.643409 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80f75809-d159-45a9-9fad-c03c902d1e1c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:27.906232 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-80f75809-d159-45a9-9fad-c03c902d1e1c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:27.916503 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-80f75809-d159-45a9-9fad-c03c902d1e1c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1520 microversion: 2.1 time: 0.296374 Sep 09 13:16:27.919251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 134/270] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:27 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:27.953041 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-6f0e5e83-af23-4de2-9eac-365844011848 req-a606b49f-4531-4d94-9e71-18c504a46e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b", "name": "network-vif-plugged", "status": "completed", "tag": "058b7f82-d7de-4f52-af06-01f11adca191"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:27.964355 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6f0e5e83-af23-4de2-9eac-365844011848 req-a606b49f-4531-4d94-9e71-18c504a46e19 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:27.965047 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6f0e5e83-af23-4de2-9eac-365844011848 req-a606b49f-4531-4d94-9e71-18c504a46e19 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:27.966674 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-6f0e5e83-af23-4de2-9eac-365844011848 req-a606b49f-4531-4d94-9e71-18c504a46e19 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:27.985740 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-6f0e5e83-af23-4de2-9eac-365844011848 req-a606b49f-4531-4d94-9e71-18c504a46e19 service nova] Creating event network-vif-plugged:058b7f82-d7de-4f52-af06-01f11adca191 for instance 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b on hv-cinder-83124 Sep 09 13:16:27.998832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-6f0e5e83-af23-4de2-9eac-365844011848 req-a606b49f-4531-4d94-9e71-18c504a46e19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052941 Sep 09 13:16:27.999477 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 137/271] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:16:28.260864 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3ae5cffb-7130-4d4e-b0f0-4bfe3cf4b43c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:28.261556 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3ae5cffb-7130-4d4e-b0f0-4bfe3cf4b43c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:28.268175 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3ae5cffb-7130-4d4e-b0f0-4bfe3cf4b43c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:28.274459 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3ae5cffb-7130-4d4e-b0f0-4bfe3cf4b43c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:28.277388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3ae5cffb-7130-4d4e-b0f0-4bfe3cf4b43c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:28.277388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3ae5cffb-7130-4d4e-b0f0-4bfe3cf4b43c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:28.277388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3ae5cffb-7130-4d4e-b0f0-4bfe3cf4b43c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:28.277388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3ae5cffb-7130-4d4e-b0f0-4bfe3cf4b43c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:28.624627 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3ae5cffb-7130-4d4e-b0f0-4bfe3cf4b43c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:28.635534 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3ae5cffb-7130-4d4e-b0f0-4bfe3cf4b43c tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1314 microversion: 2.1 time: 0.379805 Sep 09 13:16:28.642304 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 135/272] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:28 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:28.940873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-00aef10c-45d4-4887-bf01-1f9e36c7ccb4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:28.941967 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-00aef10c-45d4-4887-bf01-1f9e36c7ccb4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:28.955546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00aef10c-45d4-4887-bf01-1f9e36c7ccb4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:28.957477 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00aef10c-45d4-4887-bf01-1f9e36c7ccb4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:28.959967 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00aef10c-45d4-4887-bf01-1f9e36c7ccb4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:28.960876 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00aef10c-45d4-4887-bf01-1f9e36c7ccb4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:28.963228 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00aef10c-45d4-4887-bf01-1f9e36c7ccb4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:28.963833 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00aef10c-45d4-4887-bf01-1f9e36c7ccb4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:29.317198 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-00aef10c-45d4-4887-bf01-1f9e36c7ccb4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:29.327406 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-00aef10c-45d4-4887-bf01-1f9e36c7ccb4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1500 microversion: 2.1 time: 0.391393 Sep 09 13:16:29.328002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 138/273] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:28 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1500 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:29.353708 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ed471771-886a-4472-a18e-b65126026f3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:29.354407 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ed471771-886a-4472-a18e-b65126026f3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:29.362016 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ed471771-886a-4472-a18e-b65126026f3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:29.362819 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ed471771-886a-4472-a18e-b65126026f3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:29.363443 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ed471771-886a-4472-a18e-b65126026f3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:29.365088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ed471771-886a-4472-a18e-b65126026f3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:29.365710 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ed471771-886a-4472-a18e-b65126026f3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:29.366292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ed471771-886a-4472-a18e-b65126026f3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:29.626778 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ed471771-886a-4472-a18e-b65126026f3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:29.642664 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ed471771-886a-4472-a18e-b65126026f3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1515 microversion: 2.1 time: 0.290414 Sep 09 13:16:29.643700 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 136/274] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:29 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1515 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:29.665719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e1cad47d-f1a4-4dad-b6e4-7a395a5254b2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:29.666684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e1cad47d-f1a4-4dad-b6e4-7a395a5254b2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:29.677671 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1cad47d-f1a4-4dad-b6e4-7a395a5254b2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:29.678267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1cad47d-f1a4-4dad-b6e4-7a395a5254b2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:29.678856 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1cad47d-f1a4-4dad-b6e4-7a395a5254b2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:29.683193 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1cad47d-f1a4-4dad-b6e4-7a395a5254b2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:29.683684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1cad47d-f1a4-4dad-b6e4-7a395a5254b2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:29.685210 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1cad47d-f1a4-4dad-b6e4-7a395a5254b2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:30.226324 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e1cad47d-f1a4-4dad-b6e4-7a395a5254b2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:30.238846 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e1cad47d-f1a4-4dad-b6e4-7a395a5254b2 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1314 microversion: 2.1 time: 0.576838 Sep 09 13:16:30.240388 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 139/275] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:29 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:30.986026 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5d1e17a4-0304-43c9-8403-5ea749fee595 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Action: 'create', calling method: .version_select at 0x7fd4a19e44c0>, body: {"keypair": {"name": "tempest-keypair-568301639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzua9LzCVr/6D78Sn2EYwjI7i/6AMvZCh/8gk88TT22XWdzFhTZ6twPhL4OohEneEvJFUxlW+7kzY57rdl1gdBWhb4o/vnioIr/Y9ABJ/gN+vqqI4/BEM4FUy3sXDXk+w=="}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:31.006208 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-5d1e17a4-0304-43c9-8403-5ea749fee595 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Getting quotas for project 92f354242a7b4ae4b774681eb633c2b2. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:16:31.010741 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-5d1e17a4-0304-43c9-8403-5ea749fee595 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Getting quotas for user ca9eb6b9dc6e409a954c7993ebe5a5c3 and project 92f354242a7b4ae4b774681eb633c2b2. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:16:31.045163 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5d1e17a4-0304-43c9-8403-5ea749fee595 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.237267 Sep 09 13:16:31.045919 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 137/276] 10.222.0.17 () {62 vars in 1200 bytes} [Fri Sep 9 13:16:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 240 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 13:16:31.261485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-64c887da-91dd-4f50-bad5-65cdf8e63435 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:31.262099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64c887da-91dd-4f50-bad5-65cdf8e63435 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:31.275135 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64c887da-91dd-4f50-bad5-65cdf8e63435 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:31.275823 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64c887da-91dd-4f50-bad5-65cdf8e63435 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:31.276065 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64c887da-91dd-4f50-bad5-65cdf8e63435 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:31.276769 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64c887da-91dd-4f50-bad5-65cdf8e63435 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:31.277226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64c887da-91dd-4f50-bad5-65cdf8e63435 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:31.282229 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64c887da-91dd-4f50-bad5-65cdf8e63435 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:31.356917 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f6194173-17b2-41da-a067-9a9dc0549650 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:31.361162 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f6194173-17b2-41da-a067-9a9dc0549650 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:31.373627 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6194173-17b2-41da-a067-9a9dc0549650 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:31.375693 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6194173-17b2-41da-a067-9a9dc0549650 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:31.377579 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6194173-17b2-41da-a067-9a9dc0549650 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:31.378490 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6194173-17b2-41da-a067-9a9dc0549650 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:31.379144 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6194173-17b2-41da-a067-9a9dc0549650 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:31.379991 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6194173-17b2-41da-a067-9a9dc0549650 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:31.436107 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-f6194173-17b2-41da-a067-9a9dc0549650 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lazy-loading 'flavor' on Instance uuid 6b9110cf-907a-46bc-8e9d-31dd3c409e39 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:16:31.506785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:31.569646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f6194173-17b2-41da-a067-9a9dc0549650 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "POST /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39/action" status: 200 len: 32 microversion: 2.1 time: 0.217645 Sep 09 13:16:31.571695 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 138/277] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 13:16:31 2022] POST /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:16:31.585295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-954b0cf3-2417-43f0-ba54-0330bb6e5456 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:31.588531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-954b0cf3-2417-43f0-ba54-0330bb6e5456 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:31.597190 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-64c887da-91dd-4f50-bad5-65cdf8e63435 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:31.605393 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-954b0cf3-2417-43f0-ba54-0330bb6e5456 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:31.606470 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-954b0cf3-2417-43f0-ba54-0330bb6e5456 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:31.614442 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-954b0cf3-2417-43f0-ba54-0330bb6e5456 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:31.615775 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-954b0cf3-2417-43f0-ba54-0330bb6e5456 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:31.615897 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-64c887da-91dd-4f50-bad5-65cdf8e63435 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1498 microversion: 2.1 time: 0.358022 Sep 09 13:16:31.618440 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 140/278] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:31 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1498 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:31.618819 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-954b0cf3-2417-43f0-ba54-0330bb6e5456 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:31.619307 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-954b0cf3-2417-43f0-ba54-0330bb6e5456 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:32.052656 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-954b0cf3-2417-43f0-ba54-0330bb6e5456 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:32.062161 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-954b0cf3-2417-43f0-ba54-0330bb6e5456 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.482873 Sep 09 13:16:32.092189 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 139/279] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:31 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:32.946152 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-308c8adf-dab0-410e-9ab7-8f1b4c479f62 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:32.946753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-308c8adf-dab0-410e-9ab7-8f1b4c479f62 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:32.955529 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-308c8adf-dab0-410e-9ab7-8f1b4c479f62 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:32.956242 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-308c8adf-dab0-410e-9ab7-8f1b4c479f62 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:32.957087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-308c8adf-dab0-410e-9ab7-8f1b4c479f62 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:32.958024 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-308c8adf-dab0-410e-9ab7-8f1b4c479f62 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:32.958674 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-308c8adf-dab0-410e-9ab7-8f1b4c479f62 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:32.960286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-308c8adf-dab0-410e-9ab7-8f1b4c479f62 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:32.998478 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-308c8adf-dab0-410e-9ab7-8f1b4c479f62 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:16:33.098955 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-09c7ab6e-9663-492f-ae49-c4292328825a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:33.100819 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-09c7ab6e-9663-492f-ae49-c4292328825a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:33.113654 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09c7ab6e-9663-492f-ae49-c4292328825a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:33.114158 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09c7ab6e-9663-492f-ae49-c4292328825a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:33.115788 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09c7ab6e-9663-492f-ae49-c4292328825a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:33.129545 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09c7ab6e-9663-492f-ae49-c4292328825a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:33.130298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09c7ab6e-9663-492f-ae49-c4292328825a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:33.131530 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09c7ab6e-9663-492f-ae49-c4292328825a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:33.162127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-308c8adf-dab0-410e-9ab7-8f1b4c479f62 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 204 len: 0 microversion: 2.1 time: 0.219361 Sep 09 13:16:33.166335 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 141/280] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:16:32 2022] DELETE /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 13:16:33.188188 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-32736c79-7b1c-4e56-aec4-b1a4c1b1fc68 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:33.189082 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-32736c79-7b1c-4e56-aec4-b1a4c1b1fc68 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:33.200293 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32736c79-7b1c-4e56-aec4-b1a4c1b1fc68 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:33.206716 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32736c79-7b1c-4e56-aec4-b1a4c1b1fc68 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:33.207360 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32736c79-7b1c-4e56-aec4-b1a4c1b1fc68 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:33.208265 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32736c79-7b1c-4e56-aec4-b1a4c1b1fc68 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:33.208952 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32736c79-7b1c-4e56-aec4-b1a4c1b1fc68 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:33.209460 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-32736c79-7b1c-4e56-aec4-b1a4c1b1fc68 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:33.423506 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-09c7ab6e-9663-492f-ae49-c4292328825a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:33.433578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-09c7ab6e-9663-492f-ae49-c4292328825a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.340083 Sep 09 13:16:33.451977 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 140/281] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:33 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:33.709609 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-32736c79-7b1c-4e56-aec4-b1a4c1b1fc68 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:33.719308 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-32736c79-7b1c-4e56-aec4-b1a4c1b1fc68 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1504 microversion: 2.1 time: 0.547004 Sep 09 13:16:33.719895 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 142/282] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:33 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:33.847843 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1441102208", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41494fb6-e618-4171-a520-7ea9252e7559"}], "security_groups": [{"name": "tempest-securitygroup--449085617"}], "key_name": "tempest-keypair-568301639", "user_data": "}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:33.964185 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] validate_networks() for [('41494fb6-e618-4171-a520-7ea9252e7559', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:16:34.461151 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:16:34.462446 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:16:34.463313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:16:34.463967 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:16:34.466027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:16:34.467974 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-74221dcf-7b2f-4c6b-aec7-f238c3893fb7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:34.468768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-74221dcf-7b2f-4c6b-aec7-f238c3893fb7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:34.477633 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74221dcf-7b2f-4c6b-aec7-f238c3893fb7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:34.478955 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74221dcf-7b2f-4c6b-aec7-f238c3893fb7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:34.479454 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:34.479776 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74221dcf-7b2f-4c6b-aec7-f238c3893fb7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:34.480647 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74221dcf-7b2f-4c6b-aec7-f238c3893fb7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:34.481797 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74221dcf-7b2f-4c6b-aec7-f238c3893fb7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:34.482661 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-74221dcf-7b2f-4c6b-aec7-f238c3893fb7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:34.492024 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:34.492508 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:34.493114 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:34.497244 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:34.521679 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:34.522488 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:34.551861 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Getting quotas for project 92f354242a7b4ae4b774681eb633c2b2. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:16:34.562507 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Getting quotas for user ca9eb6b9dc6e409a954c7993ebe5a5c3 and project 92f354242a7b4ae4b774681eb633c2b2. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:16:34.586730 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:16:34.590076 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:16:34.704691 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-eeb6f279-ce19-476b-acc7-dfdbd99d9724 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.859740 Sep 09 13:16:34.705813 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 141/283] 10.222.0.17 () {62 vars in 1188 bytes} [Fri Sep 9 13:16:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 13:16:34.721698 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-29cfa3ed-ad19-4700-a8fc-f5cef5cdd038 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:34.725265 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-29cfa3ed-ad19-4700-a8fc-f5cef5cdd038 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:34.749836 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-29cfa3ed-ad19-4700-a8fc-f5cef5cdd038 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:34.750896 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-29cfa3ed-ad19-4700-a8fc-f5cef5cdd038 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:34.752984 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-29cfa3ed-ad19-4700-a8fc-f5cef5cdd038 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:34.755353 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-29cfa3ed-ad19-4700-a8fc-f5cef5cdd038 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:34.756087 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-29cfa3ed-ad19-4700-a8fc-f5cef5cdd038 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:34.756857 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-29cfa3ed-ad19-4700-a8fc-f5cef5cdd038 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:34.804947 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-74221dcf-7b2f-4c6b-aec7-f238c3893fb7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:34.830587 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-74221dcf-7b2f-4c6b-aec7-f238c3893fb7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.367669 Sep 09 13:16:34.848965 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 143/284] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:34 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:34.871101 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-02de3b9d-1548-46fa-84f9-8366f1c12da9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:34.872271 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-02de3b9d-1548-46fa-84f9-8366f1c12da9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:34.874513 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-29cfa3ed-ad19-4700-a8fc-f5cef5cdd038 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/ips" status: 200 len: 145 microversion: 2.1 time: 0.166753 Sep 09 13:16:34.880754 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 142/285] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 13:16:34 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/ips => generated 145 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:16:34.904838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7c455843-0a95-486f-99d9-e0d23e0d02d1 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:34.905498 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7c455843-0a95-486f-99d9-e0d23e0d02d1 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:34.933674 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7c455843-0a95-486f-99d9-e0d23e0d02d1 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:34.934747 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7c455843-0a95-486f-99d9-e0d23e0d02d1 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:34.935326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7c455843-0a95-486f-99d9-e0d23e0d02d1 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:34.938822 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7c455843-0a95-486f-99d9-e0d23e0d02d1 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:34.938822 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7c455843-0a95-486f-99d9-e0d23e0d02d1 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:34.938822 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7c455843-0a95-486f-99d9-e0d23e0d02d1 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:35.052833 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-02de3b9d-1548-46fa-84f9-8366f1c12da9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:35.067358 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-02de3b9d-1548-46fa-84f9-8366f1c12da9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:35.069236 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-02de3b9d-1548-46fa-84f9-8366f1c12da9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:35.070632 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-02de3b9d-1548-46fa-84f9-8366f1c12da9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1281 microversion: 2.20 time: 0.216681 Sep 09 13:16:35.086719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 144/286] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:34 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1281 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:16:35.412471 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7c455843-0a95-486f-99d9-e0d23e0d02d1 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:35.421852 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7c455843-0a95-486f-99d9-e0d23e0d02d1 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1504 microversion: 2.1 time: 0.538039 Sep 09 13:16:35.427682 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 143/287] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:34 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1504 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:35.854026 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51de2dc6-b11a-4dc4-9994-6d4c29ac96a7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:35.854660 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-51de2dc6-b11a-4dc4-9994-6d4c29ac96a7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:35.863162 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51de2dc6-b11a-4dc4-9994-6d4c29ac96a7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:35.864230 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51de2dc6-b11a-4dc4-9994-6d4c29ac96a7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:35.865140 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51de2dc6-b11a-4dc4-9994-6d4c29ac96a7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:35.865855 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51de2dc6-b11a-4dc4-9994-6d4c29ac96a7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:35.866477 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51de2dc6-b11a-4dc4-9994-6d4c29ac96a7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:35.867164 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51de2dc6-b11a-4dc4-9994-6d4c29ac96a7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:36.030251 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-51de2dc6-b11a-4dc4-9994-6d4c29ac96a7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:36.041968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-51de2dc6-b11a-4dc4-9994-6d4c29ac96a7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.191570 Sep 09 13:16:36.043154 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 145/288] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:35 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:36.065278 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-9f3966f6-ec70-4a5d-99fc-f37da1af4f42 req-22dcb4ec-8332-4c39-a043-13af9fd44c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b", "name": "network-vif-deleted", "tag": "058b7f82-d7de-4f52-af06-01f11adca191"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:36.076080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-9f3966f6-ec70-4a5d-99fc-f37da1af4f42 req-22dcb4ec-8332-4c39-a043-13af9fd44c46 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:36.076556 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-9f3966f6-ec70-4a5d-99fc-f37da1af4f42 req-22dcb4ec-8332-4c39-a043-13af9fd44c46 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:36.077196 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-9f3966f6-ec70-4a5d-99fc-f37da1af4f42 req-22dcb4ec-8332-4c39-a043-13af9fd44c46 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:36.090612 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-9f3966f6-ec70-4a5d-99fc-f37da1af4f42 req-22dcb4ec-8332-4c39-a043-13af9fd44c46 service nova] Creating event network-vif-deleted:058b7f82-d7de-4f52-af06-01f11adca191 for instance 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b on hv-cinder-83124 Sep 09 13:16:36.095997 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-9f3966f6-ec70-4a5d-99fc-f37da1af4f42 req-22dcb4ec-8332-4c39-a043-13af9fd44c46 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035269 Sep 09 13:16:36.096647 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 144/289] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:16:36.097741 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c07345e9-93c2-4d08-8970-f447720e0942 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:36.098689 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c07345e9-93c2-4d08-8970-f447720e0942 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:36.105452 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07345e9-93c2-4d08-8970-f447720e0942 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:36.106657 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07345e9-93c2-4d08-8970-f447720e0942 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:36.107625 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07345e9-93c2-4d08-8970-f447720e0942 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:36.108335 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07345e9-93c2-4d08-8970-f447720e0942 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:36.108796 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07345e9-93c2-4d08-8970-f447720e0942 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:36.109228 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c07345e9-93c2-4d08-8970-f447720e0942 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:36.186287 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c07345e9-93c2-4d08-8970-f447720e0942 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:36.196060 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c07345e9-93c2-4d08-8970-f447720e0942 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:36.197959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c07345e9-93c2-4d08-8970-f447720e0942 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:36.199071 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c07345e9-93c2-4d08-8970-f447720e0942 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1333 microversion: 2.20 time: 0.106973 Sep 09 13:16:36.200426 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 146/290] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:36 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:16:36.460100 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-69fc7857-c204-422e-b860-99e3136440e9 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:36.461030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-69fc7857-c204-422e-b860-99e3136440e9 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:36.468888 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69fc7857-c204-422e-b860-99e3136440e9 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:36.469653 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69fc7857-c204-422e-b860-99e3136440e9 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:36.470351 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69fc7857-c204-422e-b860-99e3136440e9 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:36.471475 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69fc7857-c204-422e-b860-99e3136440e9 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:36.472137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69fc7857-c204-422e-b860-99e3136440e9 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:36.472886 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69fc7857-c204-422e-b860-99e3136440e9 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:36.667436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69fc7857-c204-422e-b860-99e3136440e9 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:36.668019 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69fc7857-c204-422e-b860-99e3136440e9 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:36.669232 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69fc7857-c204-422e-b860-99e3136440e9 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:36.669713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-69fc7857-c204-422e-b860-99e3136440e9 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lazy-loading 'fault' on Instance uuid 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:16:36.732182 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-69fc7857-c204-422e-b860-99e3136440e9 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73fdae39484489facaf6831430cd4d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38013a20eb4c8e830e391cc06f485f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:36.741715 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-69fc7857-c204-422e-b860-99e3136440e9 tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 200 len: 1304 microversion: 2.1 time: 0.285663 Sep 09 13:16:36.742452 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 145/291] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:36 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 1304 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:37.067565 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-88f8ebe7-9506-4b51-959e-f799a53e3a22 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:37.068878 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-88f8ebe7-9506-4b51-959e-f799a53e3a22 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:37.080246 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88f8ebe7-9506-4b51-959e-f799a53e3a22 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:37.082025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88f8ebe7-9506-4b51-959e-f799a53e3a22 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:37.083824 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88f8ebe7-9506-4b51-959e-f799a53e3a22 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:37.084557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88f8ebe7-9506-4b51-959e-f799a53e3a22 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:37.085022 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88f8ebe7-9506-4b51-959e-f799a53e3a22 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:37.085460 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88f8ebe7-9506-4b51-959e-f799a53e3a22 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:37.225859 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-10f0969e-0f42-4771-a2c7-25c4539a5c04 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:37.227761 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-10f0969e-0f42-4771-a2c7-25c4539a5c04 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:37.236740 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-10f0969e-0f42-4771-a2c7-25c4539a5c04 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:37.237671 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-10f0969e-0f42-4771-a2c7-25c4539a5c04 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:37.238395 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-10f0969e-0f42-4771-a2c7-25c4539a5c04 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:37.239129 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-10f0969e-0f42-4771-a2c7-25c4539a5c04 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:37.240242 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-10f0969e-0f42-4771-a2c7-25c4539a5c04 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:37.240857 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-10f0969e-0f42-4771-a2c7-25c4539a5c04 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:37.308260 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-88f8ebe7-9506-4b51-959e-f799a53e3a22 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:37.319582 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-88f8ebe7-9506-4b51-959e-f799a53e3a22 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.256451 Sep 09 13:16:37.322105 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 147/292] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:37 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:37.413549 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-10f0969e-0f42-4771-a2c7-25c4539a5c04 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:37.424554 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-10f0969e-0f42-4771-a2c7-25c4539a5c04 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:37.426193 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-10f0969e-0f42-4771-a2c7-25c4539a5c04 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:37.427346 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-10f0969e-0f42-4771-a2c7-25c4539a5c04 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1339 microversion: 2.20 time: 0.205352 Sep 09 13:16:37.438852 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 146/293] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:37 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1339 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:16:37.765723 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e03bf336-fc87-4a9c-8cf3-59f61f88a3cb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:37.770385 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e03bf336-fc87-4a9c-8cf3-59f61f88a3cb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] [instance: 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:37.780228 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e03bf336-fc87-4a9c-8cf3-59f61f88a3cb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:37.780724 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e03bf336-fc87-4a9c-8cf3-59f61f88a3cb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:37.781163 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e03bf336-fc87-4a9c-8cf3-59f61f88a3cb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:37.781875 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e03bf336-fc87-4a9c-8cf3-59f61f88a3cb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:37.782334 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e03bf336-fc87-4a9c-8cf3-59f61f88a3cb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:37.782754 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e03bf336-fc87-4a9c-8cf3-59f61f88a3cb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:37.818813 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-e03bf336-fc87-4a9c-8cf3-59f61f88a3cb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] HTTP exception thrown: Instance 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b could not be found. Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e03bf336-fc87-4a9c-8cf3-59f61f88a3cb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Request method failure captured: Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b HTTP/1.1 Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzx8RNwDPOM0hMIkkH53JmuZ5UzlrWe9mluR1Dtul5kFujY4hk9yDxL4TIfkNF_dVcQNcYQ3bcg25blhf3zW8LhhlHf-wsA1acQcmA1x8JtBZub35yrU2T078NXexrdcND82B24a_outch8iQuPbIFKYhzUhiUR_PABajtXiFpu44j4 Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: ca38013a20eb4c8e830e391cc06f485f Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesActionsTest-1440914682 Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:16:37.839511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:16:37.841331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ca38013a20eb4c8e830e391cc06f485f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ca38013a20eb4c8e830e391cc06f485f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ca38013a20eb4c8e830e391cc06f485f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ca38013a20eb4c8e830e391cc06f485f", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:16:37.841331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesActionsTest-1440914682 Sep 09 13:16:37.841331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: ca38013a20eb4c8e830e391cc06f485f Sep 09 13:16:37.841331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesActionsTest-1440914682 Sep 09 13:16:37.841331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesActionsTest-1440914682-project Sep 09 13:16:37.841331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:16:37.841331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:16:37.841331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: d73fdae39484489facaf6831430cd4d7 Sep 09 13:16:37.841331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesActionsTest-1440914682-project Sep 09 13:16:37.841331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:16:37.841331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b could not be found. Sep 09 13:16:37.841331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b'} Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b could not be found. Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:16:37.842016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b could not be found. Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b could not be found. Sep 09 13:16:37.844099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:37.846287 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e03bf336-fc87-4a9c-8cf3-59f61f88a3cb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] Returning 404 to user: Instance 5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:16:37.847918 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e03bf336-fc87-4a9c-8cf3-59f61f88a3cb tempest-VolumesActionsTest-1440914682 tempest-VolumesActionsTest-1440914682-project] 10.222.0.17 "GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b" status: 404 len: 111 microversion: 2.1 time: 0.085062 Sep 09 13:16:37.848503 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 148/294] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:37 2022] GET /compute/v2.1/servers/5d82f9d4-53f5-407f-84bf-5aecfdeb0b3b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 13:16:38.358419 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-373f6886-3b46-48ff-99c9-f0c5ea1ebccf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:38.360073 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-373f6886-3b46-48ff-99c9-f0c5ea1ebccf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:38.383808 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-373f6886-3b46-48ff-99c9-f0c5ea1ebccf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:38.384707 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-373f6886-3b46-48ff-99c9-f0c5ea1ebccf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:38.398720 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-373f6886-3b46-48ff-99c9-f0c5ea1ebccf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:38.400229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-373f6886-3b46-48ff-99c9-f0c5ea1ebccf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:38.400840 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-373f6886-3b46-48ff-99c9-f0c5ea1ebccf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:38.402560 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-373f6886-3b46-48ff-99c9-f0c5ea1ebccf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:38.417014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a8668c9d-265d-41cf-86a3-9f4f6a0f8c6b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:38.417519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a8668c9d-265d-41cf-86a3-9f4f6a0f8c6b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:38.432484 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8668c9d-265d-41cf-86a3-9f4f6a0f8c6b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:38.434593 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8668c9d-265d-41cf-86a3-9f4f6a0f8c6b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:38.435305 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8668c9d-265d-41cf-86a3-9f4f6a0f8c6b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:38.436326 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8668c9d-265d-41cf-86a3-9f4f6a0f8c6b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:38.439595 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8668c9d-265d-41cf-86a3-9f4f6a0f8c6b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:38.440381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a8668c9d-265d-41cf-86a3-9f4f6a0f8c6b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:38.502104 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a8668c9d-265d-41cf-86a3-9f4f6a0f8c6b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/ips" status: 200 len: 151 microversion: 2.1 time: 0.089507 Sep 09 13:16:38.505199 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 149/295] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 13:16:38 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/ips => generated 151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:16:38.518648 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-422d8e62-dd76-4a68-a141-30d07dd94787 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:38.522392 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-422d8e62-dd76-4a68-a141-30d07dd94787 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:38.536570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-422d8e62-dd76-4a68-a141-30d07dd94787 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:38.537269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-422d8e62-dd76-4a68-a141-30d07dd94787 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:38.537974 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-422d8e62-dd76-4a68-a141-30d07dd94787 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:38.538873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-422d8e62-dd76-4a68-a141-30d07dd94787 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:38.539559 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-422d8e62-dd76-4a68-a141-30d07dd94787 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:38.540171 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-422d8e62-dd76-4a68-a141-30d07dd94787 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:38.680251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-373f6886-3b46-48ff-99c9-f0c5ea1ebccf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:38.690261 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-373f6886-3b46-48ff-99c9-f0c5ea1ebccf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.347732 Sep 09 13:16:38.694816 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 147/296] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:38 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:38.795924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-422d8e62-dd76-4a68-a141-30d07dd94787 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:38.806245 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-422d8e62-dd76-4a68-a141-30d07dd94787 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:38.810380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-422d8e62-dd76-4a68-a141-30d07dd94787 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:38.812482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-422d8e62-dd76-4a68-a141-30d07dd94787 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1406 microversion: 2.20 time: 0.304566 Sep 09 13:16:38.813250 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 150/297] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:38 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:16:38.926879 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-1ca79552-25c2-4298-88ca-183952ccd3b3 req-791fb4d9-32f1-4efc-ba9c-78c10854b446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f961e5a-6c12-48b6-ae52-e61b993275b3", "tag": "b38055a2-318f-4ddd-8392-48b0e32eee23"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:38.940015 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1ca79552-25c2-4298-88ca-183952ccd3b3 req-791fb4d9-32f1-4efc-ba9c-78c10854b446 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:38.940975 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1ca79552-25c2-4298-88ca-183952ccd3b3 req-791fb4d9-32f1-4efc-ba9c-78c10854b446 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:38.941989 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1ca79552-25c2-4298-88ca-183952ccd3b3 req-791fb4d9-32f1-4efc-ba9c-78c10854b446 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:38.957384 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-1ca79552-25c2-4298-88ca-183952ccd3b3 req-791fb4d9-32f1-4efc-ba9c-78c10854b446 service nova] Creating event network-changed:b38055a2-318f-4ddd-8392-48b0e32eee23 for instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 on hv-cinder-83124 Sep 09 13:16:38.965716 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-1ca79552-25c2-4298-88ca-183952ccd3b3 req-791fb4d9-32f1-4efc-ba9c-78c10854b446 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042231 Sep 09 13:16:38.967583 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 148/298] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:16:39.155994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fce02eb7-cfd0-4ca4-9196-a5645087dfd3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6efade23-db87-4836-ae05-0e99aaff0d92"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:39.158623 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fce02eb7-cfd0-4ca4-9196-a5645087dfd3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:39.166444 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fce02eb7-cfd0-4ca4-9196-a5645087dfd3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:39.166769 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fce02eb7-cfd0-4ca4-9196-a5645087dfd3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:39.167330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fce02eb7-cfd0-4ca4-9196-a5645087dfd3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:39.168037 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fce02eb7-cfd0-4ca4-9196-a5645087dfd3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:39.171678 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fce02eb7-cfd0-4ca4-9196-a5645087dfd3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:39.172152 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fce02eb7-cfd0-4ca4-9196-a5645087dfd3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:39.713513 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-90af4b1b-f964-4904-9ec7-d74cb9f88b4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:39.714771 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-90af4b1b-f964-4904-9ec7-d74cb9f88b4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:39.721010 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90af4b1b-f964-4904-9ec7-d74cb9f88b4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:39.721492 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90af4b1b-f964-4904-9ec7-d74cb9f88b4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:39.722102 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90af4b1b-f964-4904-9ec7-d74cb9f88b4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:39.722794 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90af4b1b-f964-4904-9ec7-d74cb9f88b4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:39.723285 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90af4b1b-f964-4904-9ec7-d74cb9f88b4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:39.723714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90af4b1b-f964-4904-9ec7-d74cb9f88b4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:39.867764 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-90af4b1b-f964-4904-9ec7-d74cb9f88b4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:39.876262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-90af4b1b-f964-4904-9ec7-d74cb9f88b4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.166680 Sep 09 13:16:39.877331 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 149/299] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:39 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:39.882392 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3338cda8-8efc-478a-aaa0-3e0b1f7e3f93 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:39.882985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3338cda8-8efc-478a-aaa0-3e0b1f7e3f93 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:39.889437 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3338cda8-8efc-478a-aaa0-3e0b1f7e3f93 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:39.889919 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3338cda8-8efc-478a-aaa0-3e0b1f7e3f93 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:39.890346 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3338cda8-8efc-478a-aaa0-3e0b1f7e3f93 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:39.891023 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3338cda8-8efc-478a-aaa0-3e0b1f7e3f93 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:39.891808 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3338cda8-8efc-478a-aaa0-3e0b1f7e3f93 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:39.892232 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3338cda8-8efc-478a-aaa0-3e0b1f7e3f93 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:40.026088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3338cda8-8efc-478a-aaa0-3e0b1f7e3f93 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:40.036792 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3338cda8-8efc-478a-aaa0-3e0b1f7e3f93 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:40.038277 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3338cda8-8efc-478a-aaa0-3e0b1f7e3f93 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:40.039379 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3338cda8-8efc-478a-aaa0-3e0b1f7e3f93 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1406 microversion: 2.20 time: 0.160709 Sep 09 13:16:40.039921 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 150/300] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:39 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:16:40.900621 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bd162ed1-7ee1-4a54-bbea-808617db3484 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:40.901360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bd162ed1-7ee1-4a54-bbea-808617db3484 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:40.907809 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd162ed1-7ee1-4a54-bbea-808617db3484 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:40.908292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd162ed1-7ee1-4a54-bbea-808617db3484 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:40.908728 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd162ed1-7ee1-4a54-bbea-808617db3484 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:40.909415 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd162ed1-7ee1-4a54-bbea-808617db3484 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:40.909879 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd162ed1-7ee1-4a54-bbea-808617db3484 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:40.910301 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd162ed1-7ee1-4a54-bbea-808617db3484 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:41.047883 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bd162ed1-7ee1-4a54-bbea-808617db3484 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:41.055442 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bd162ed1-7ee1-4a54-bbea-808617db3484 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.159049 Sep 09 13:16:41.056024 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 151/301] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:40 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:41.064317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fe43672f-f7ad-434f-91a9-166e7a9b6195 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:41.064925 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fe43672f-f7ad-434f-91a9-166e7a9b6195 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:41.071140 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe43672f-f7ad-434f-91a9-166e7a9b6195 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:41.071768 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe43672f-f7ad-434f-91a9-166e7a9b6195 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:41.072279 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe43672f-f7ad-434f-91a9-166e7a9b6195 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:41.073092 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe43672f-f7ad-434f-91a9-166e7a9b6195 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:41.073624 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe43672f-f7ad-434f-91a9-166e7a9b6195 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:41.074238 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fe43672f-f7ad-434f-91a9-166e7a9b6195 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:41.213898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fe43672f-f7ad-434f-91a9-166e7a9b6195 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:41.223081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fe43672f-f7ad-434f-91a9-166e7a9b6195 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:41.224518 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fe43672f-f7ad-434f-91a9-166e7a9b6195 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:41.225648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fe43672f-f7ad-434f-91a9-166e7a9b6195 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1406 microversion: 2.20 time: 0.165175 Sep 09 13:16:41.226198 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 152/302] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:41 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:16:41.415021 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fce02eb7-cfd0-4ca4-9196-a5645087dfd3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "POST /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.264452 Sep 09 13:16:41.415587 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 151/303] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 13:16:39 2022] POST /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/os-volume_attachments => generated 194 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:16:42.080124 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5dceab11-22ee-45c3-a542-9f65ddd2102b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:42.080664 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5dceab11-22ee-45c3-a542-9f65ddd2102b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:42.086591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5dceab11-22ee-45c3-a542-9f65ddd2102b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:42.087097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5dceab11-22ee-45c3-a542-9f65ddd2102b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:42.087538 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5dceab11-22ee-45c3-a542-9f65ddd2102b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:42.088220 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5dceab11-22ee-45c3-a542-9f65ddd2102b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:42.088672 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5dceab11-22ee-45c3-a542-9f65ddd2102b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:42.089095 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5dceab11-22ee-45c3-a542-9f65ddd2102b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:42.220818 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5dceab11-22ee-45c3-a542-9f65ddd2102b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:42.228687 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5dceab11-22ee-45c3-a542-9f65ddd2102b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.152474 Sep 09 13:16:42.229249 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 153/304] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:42 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:42.251206 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-90358516-0868-420a-b704-88f1c67b40cc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:42.251929 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-90358516-0868-420a-b704-88f1c67b40cc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:42.253849 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:42.259290 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90358516-0868-420a-b704-88f1c67b40cc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:42.259769 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90358516-0868-420a-b704-88f1c67b40cc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:42.260198 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90358516-0868-420a-b704-88f1c67b40cc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:42.260883 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90358516-0868-420a-b704-88f1c67b40cc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:42.261331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90358516-0868-420a-b704-88f1c67b40cc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:42.261808 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90358516-0868-420a-b704-88f1c67b40cc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:42.398193 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-90358516-0868-420a-b704-88f1c67b40cc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:42.401767 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:42.408427 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-90358516-0868-420a-b704-88f1c67b40cc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:42.409879 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-90358516-0868-420a-b704-88f1c67b40cc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:42.411018 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-90358516-0868-420a-b704-88f1c67b40cc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1406 microversion: 2.20 time: 0.165066 Sep 09 13:16:42.411588 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 152/305] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:42 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:16:43.253304 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-46683950-7d2b-4933-9f18-198f8d4390a8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:43.253915 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-46683950-7d2b-4933-9f18-198f8d4390a8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:43.259926 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46683950-7d2b-4933-9f18-198f8d4390a8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:43.260409 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46683950-7d2b-4933-9f18-198f8d4390a8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:43.260842 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46683950-7d2b-4933-9f18-198f8d4390a8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:43.261528 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46683950-7d2b-4933-9f18-198f8d4390a8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:43.262009 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46683950-7d2b-4933-9f18-198f8d4390a8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:43.263127 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46683950-7d2b-4933-9f18-198f8d4390a8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:43.390020 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-46683950-7d2b-4933-9f18-198f8d4390a8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:43.398617 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-46683950-7d2b-4933-9f18-198f8d4390a8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.149079 Sep 09 13:16:43.399203 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 154/306] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:43 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:43.436809 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f290163e-6c71-4490-80d8-dfb774f63d1a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:43.437447 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f290163e-6c71-4490-80d8-dfb774f63d1a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:43.445118 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f290163e-6c71-4490-80d8-dfb774f63d1a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:43.445508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f290163e-6c71-4490-80d8-dfb774f63d1a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:43.445942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f290163e-6c71-4490-80d8-dfb774f63d1a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:43.446636 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f290163e-6c71-4490-80d8-dfb774f63d1a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:43.447107 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f290163e-6c71-4490-80d8-dfb774f63d1a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:43.447530 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f290163e-6c71-4490-80d8-dfb774f63d1a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:43.577062 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f290163e-6c71-4490-80d8-dfb774f63d1a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:43.585527 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f290163e-6c71-4490-80d8-dfb774f63d1a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:43.587007 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f290163e-6c71-4490-80d8-dfb774f63d1a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:43.588249 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f290163e-6c71-4490-80d8-dfb774f63d1a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1406 microversion: 2.20 time: 0.156071 Sep 09 13:16:43.588977 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 153/307] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:43 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:16:44.422041 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d3a911e6-df0e-49db-b2f0-c5544b8cdba2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:44.422654 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d3a911e6-df0e-49db-b2f0-c5544b8cdba2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:44.429057 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3a911e6-df0e-49db-b2f0-c5544b8cdba2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:44.429545 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3a911e6-df0e-49db-b2f0-c5544b8cdba2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:44.429984 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3a911e6-df0e-49db-b2f0-c5544b8cdba2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:44.430695 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3a911e6-df0e-49db-b2f0-c5544b8cdba2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:44.431181 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3a911e6-df0e-49db-b2f0-c5544b8cdba2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:44.431610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d3a911e6-df0e-49db-b2f0-c5544b8cdba2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:44.535551 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:44.572262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d3a911e6-df0e-49db-b2f0-c5544b8cdba2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:44.578405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=10 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:44.580640 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d3a911e6-df0e-49db-b2f0-c5544b8cdba2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.162915 Sep 09 13:16:44.581201 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 155/308] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:44 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:44.616353 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9db73ea8-3208-4562-9419-f2138aadc001 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:44.617042 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9db73ea8-3208-4562-9419-f2138aadc001 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:44.624010 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9db73ea8-3208-4562-9419-f2138aadc001 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:44.624594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9db73ea8-3208-4562-9419-f2138aadc001 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:44.625023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9db73ea8-3208-4562-9419-f2138aadc001 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:44.625726 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9db73ea8-3208-4562-9419-f2138aadc001 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:44.626180 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9db73ea8-3208-4562-9419-f2138aadc001 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:44.626614 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9db73ea8-3208-4562-9419-f2138aadc001 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:44.760412 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9db73ea8-3208-4562-9419-f2138aadc001 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:44.768763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9db73ea8-3208-4562-9419-f2138aadc001 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:44.770249 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9db73ea8-3208-4562-9419-f2138aadc001 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:44.771374 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9db73ea8-3208-4562-9419-f2138aadc001 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1406 microversion: 2.20 time: 0.159310 Sep 09 13:16:44.771916 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 154/309] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:44 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:16:45.413783 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-965ddef6-083f-4662-8fcc-6828c6edf3c9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b2a05b6-dc71-4e8a-be9c-d0cb28c02b64"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:45.416234 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-965ddef6-083f-4662-8fcc-6828c6edf3c9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:45.423692 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-965ddef6-083f-4662-8fcc-6828c6edf3c9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:45.424258 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-965ddef6-083f-4662-8fcc-6828c6edf3c9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:45.424590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-965ddef6-083f-4662-8fcc-6828c6edf3c9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:45.425276 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-965ddef6-083f-4662-8fcc-6828c6edf3c9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:45.425729 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-965ddef6-083f-4662-8fcc-6828c6edf3c9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:45.426153 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-965ddef6-083f-4662-8fcc-6828c6edf3c9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:45.497612 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:45.605146 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7bafa5c1-b2ac-4d4b-9a0b-d56df0c11ee7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:45.606454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7bafa5c1-b2ac-4d4b-9a0b-d56df0c11ee7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:45.608651 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:45.614539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bafa5c1-b2ac-4d4b-9a0b-d56df0c11ee7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:45.615330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bafa5c1-b2ac-4d4b-9a0b-d56df0c11ee7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:45.615974 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bafa5c1-b2ac-4d4b-9a0b-d56df0c11ee7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:45.616678 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bafa5c1-b2ac-4d4b-9a0b-d56df0c11ee7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:45.617207 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bafa5c1-b2ac-4d4b-9a0b-d56df0c11ee7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:45.617534 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7bafa5c1-b2ac-4d4b-9a0b-d56df0c11ee7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:45.788159 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7bafa5c1-b2ac-4d4b-9a0b-d56df0c11ee7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:45.796744 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7bafa5c1-b2ac-4d4b-9a0b-d56df0c11ee7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.195995 Sep 09 13:16:45.797606 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 155/310] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:45 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:45.802510 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-19d16503-ddb6-43dd-936a-acd75bb38e71 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:45.803305 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-19d16503-ddb6-43dd-936a-acd75bb38e71 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:45.809576 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19d16503-ddb6-43dd-936a-acd75bb38e71 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:45.810098 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19d16503-ddb6-43dd-936a-acd75bb38e71 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:45.810606 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19d16503-ddb6-43dd-936a-acd75bb38e71 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:45.811470 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19d16503-ddb6-43dd-936a-acd75bb38e71 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:45.812232 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19d16503-ddb6-43dd-936a-acd75bb38e71 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:45.812661 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-19d16503-ddb6-43dd-936a-acd75bb38e71 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:45.975226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-19d16503-ddb6-43dd-936a-acd75bb38e71 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:45.997006 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-19d16503-ddb6-43dd-936a-acd75bb38e71 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:46.015971 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-19d16503-ddb6-43dd-936a-acd75bb38e71 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:46.020413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-19d16503-ddb6-43dd-936a-acd75bb38e71 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1406 microversion: 2.20 time: 0.221617 Sep 09 13:16:46.021062 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 156/311] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:45 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:16:46.053719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-965ddef6-083f-4662-8fcc-6828c6edf3c9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "POST /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.643652 Sep 09 13:16:46.061250 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 156/312] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 13:16:45 2022] POST /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments => generated 194 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:16:46.822237 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-531f3563-efc6-4ca2-a959-db055b5c75f1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:46.823648 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-531f3563-efc6-4ca2-a959-db055b5c75f1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:46.833260 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-531f3563-efc6-4ca2-a959-db055b5c75f1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:46.834137 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-531f3563-efc6-4ca2-a959-db055b5c75f1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:46.834791 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-531f3563-efc6-4ca2-a959-db055b5c75f1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:46.835579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-531f3563-efc6-4ca2-a959-db055b5c75f1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:46.836236 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-531f3563-efc6-4ca2-a959-db055b5c75f1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:46.836850 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-531f3563-efc6-4ca2-a959-db055b5c75f1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:47.049468 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9fa1e1f4-60a7-4718-8b89-f189edbc25a2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:47.050812 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9fa1e1f4-60a7-4718-8b89-f189edbc25a2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:47.060661 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9fa1e1f4-60a7-4718-8b89-f189edbc25a2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:47.062102 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9fa1e1f4-60a7-4718-8b89-f189edbc25a2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:47.062773 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9fa1e1f4-60a7-4718-8b89-f189edbc25a2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:47.064038 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9fa1e1f4-60a7-4718-8b89-f189edbc25a2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:47.064842 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9fa1e1f4-60a7-4718-8b89-f189edbc25a2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:47.065435 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9fa1e1f4-60a7-4718-8b89-f189edbc25a2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:47.147226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-531f3563-efc6-4ca2-a959-db055b5c75f1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:47.183530 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-531f3563-efc6-4ca2-a959-db055b5c75f1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.365987 Sep 09 13:16:47.184217 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 157/313] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:46 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:47.328043 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9fa1e1f4-60a7-4718-8b89-f189edbc25a2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:47.345627 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9fa1e1f4-60a7-4718-8b89-f189edbc25a2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:47.350709 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9fa1e1f4-60a7-4718-8b89-f189edbc25a2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:47.355170 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9fa1e1f4-60a7-4718-8b89-f189edbc25a2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1406 microversion: 2.20 time: 0.312092 Sep 09 13:16:47.361702 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 157/314] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:47 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:16:48.291154 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ccaa7fb-6f79-4e10-ac7c-b6da8d4605df tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:48.293362 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ccaa7fb-6f79-4e10-ac7c-b6da8d4605df tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:48.303841 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ccaa7fb-6f79-4e10-ac7c-b6da8d4605df tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:48.304528 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ccaa7fb-6f79-4e10-ac7c-b6da8d4605df tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:48.305651 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ccaa7fb-6f79-4e10-ac7c-b6da8d4605df tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:48.306844 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ccaa7fb-6f79-4e10-ac7c-b6da8d4605df tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:48.307515 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ccaa7fb-6f79-4e10-ac7c-b6da8d4605df tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:48.308128 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ccaa7fb-6f79-4e10-ac7c-b6da8d4605df tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:48.387001 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-69cfb205-8e64-4adb-91a2-f373d230bf29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:48.388445 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-69cfb205-8e64-4adb-91a2-f373d230bf29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:48.401610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69cfb205-8e64-4adb-91a2-f373d230bf29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:48.402518 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69cfb205-8e64-4adb-91a2-f373d230bf29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:48.406106 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69cfb205-8e64-4adb-91a2-f373d230bf29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:48.407065 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69cfb205-8e64-4adb-91a2-f373d230bf29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:48.407681 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69cfb205-8e64-4adb-91a2-f373d230bf29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:48.410244 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-69cfb205-8e64-4adb-91a2-f373d230bf29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:48.518710 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ccaa7fb-6f79-4e10-ac7c-b6da8d4605df tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:48.529019 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ccaa7fb-6f79-4e10-ac7c-b6da8d4605df tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.262225 Sep 09 13:16:48.530487 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 158/315] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:48 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:48.717812 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-69cfb205-8e64-4adb-91a2-f373d230bf29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:48.731485 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-69cfb205-8e64-4adb-91a2-f373d230bf29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:48.733760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-69cfb205-8e64-4adb-91a2-f373d230bf29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:48.735279 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-69cfb205-8e64-4adb-91a2-f373d230bf29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1406 microversion: 2.20 time: 0.352814 Sep 09 13:16:48.736129 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 158/316] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:48 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:16:49.553372 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0c61bde7-f447-4c9c-9896-2307572049ef tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:49.555888 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0c61bde7-f447-4c9c-9896-2307572049ef tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:49.568539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c61bde7-f447-4c9c-9896-2307572049ef tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:49.569012 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c61bde7-f447-4c9c-9896-2307572049ef tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:49.572459 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c61bde7-f447-4c9c-9896-2307572049ef tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:49.573266 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c61bde7-f447-4c9c-9896-2307572049ef tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:49.573871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c61bde7-f447-4c9c-9896-2307572049ef tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:49.576215 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0c61bde7-f447-4c9c-9896-2307572049ef tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:49.697120 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-63bff5fe-6b11-43f9-9fe5-c1b8ac277fd1 req-3ee7a62d-7567-433d-8949-e7383802ff71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f961e5a-6c12-48b6-ae52-e61b993275b3", "name": "network-vif-plugged", "status": "completed", "tag": "b38055a2-318f-4ddd-8392-48b0e32eee23"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:49.718781 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-63bff5fe-6b11-43f9-9fe5-c1b8ac277fd1 req-3ee7a62d-7567-433d-8949-e7383802ff71 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:49.719294 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-63bff5fe-6b11-43f9-9fe5-c1b8ac277fd1 req-3ee7a62d-7567-433d-8949-e7383802ff71 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:49.719725 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-63bff5fe-6b11-43f9-9fe5-c1b8ac277fd1 req-3ee7a62d-7567-433d-8949-e7383802ff71 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:49.751433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-63bff5fe-6b11-43f9-9fe5-c1b8ac277fd1 req-3ee7a62d-7567-433d-8949-e7383802ff71 service nova] Creating event network-vif-plugged:b38055a2-318f-4ddd-8392-48b0e32eee23 for instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 on hv-cinder-83124 Sep 09 13:16:49.770675 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-63bff5fe-6b11-43f9-9fe5-c1b8ac277fd1 req-3ee7a62d-7567-433d-8949-e7383802ff71 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078734 Sep 09 13:16:49.774472 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 159/317] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:16:49.791035 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-26891f2a-f095-49ff-b562-f2da89dcedd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:49.791889 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-26891f2a-f095-49ff-b562-f2da89dcedd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:49.810127 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-26891f2a-f095-49ff-b562-f2da89dcedd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:49.810616 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-26891f2a-f095-49ff-b562-f2da89dcedd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:49.811072 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-26891f2a-f095-49ff-b562-f2da89dcedd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:49.811972 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-26891f2a-f095-49ff-b562-f2da89dcedd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:49.812600 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-26891f2a-f095-49ff-b562-f2da89dcedd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:49.813227 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-26891f2a-f095-49ff-b562-f2da89dcedd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:49.934582 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0c61bde7-f447-4c9c-9896-2307572049ef tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:49.946806 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0c61bde7-f447-4c9c-9896-2307572049ef tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.397156 Sep 09 13:16:49.947649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 159/318] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:49 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:50.052743 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-26891f2a-f095-49ff-b562-f2da89dcedd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:50.079345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-26891f2a-f095-49ff-b562-f2da89dcedd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:50.081405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-26891f2a-f095-49ff-b562-f2da89dcedd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:50.082653 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-26891f2a-f095-49ff-b562-f2da89dcedd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1406 microversion: 2.20 time: 0.305682 Sep 09 13:16:50.083352 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 160/319] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:49 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:16:50.971540 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-65f2e9c7-f813-4d74-8988-7b065ab37c4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:50.972156 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-65f2e9c7-f813-4d74-8988-7b065ab37c4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:50.985518 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65f2e9c7-f813-4d74-8988-7b065ab37c4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:50.985891 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65f2e9c7-f813-4d74-8988-7b065ab37c4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:50.986381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65f2e9c7-f813-4d74-8988-7b065ab37c4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:50.987113 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65f2e9c7-f813-4d74-8988-7b065ab37c4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:50.987581 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65f2e9c7-f813-4d74-8988-7b065ab37c4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:50.990221 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-65f2e9c7-f813-4d74-8988-7b065ab37c4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:51.110429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4d2bd0df-0166-4923-ba8e-dad8c15d36c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:51.111122 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4d2bd0df-0166-4923-ba8e-dad8c15d36c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:51.118796 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d2bd0df-0166-4923-ba8e-dad8c15d36c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:51.119543 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d2bd0df-0166-4923-ba8e-dad8c15d36c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:51.120193 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d2bd0df-0166-4923-ba8e-dad8c15d36c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:51.121545 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d2bd0df-0166-4923-ba8e-dad8c15d36c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:51.122088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d2bd0df-0166-4923-ba8e-dad8c15d36c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:51.122778 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4d2bd0df-0166-4923-ba8e-dad8c15d36c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:51.308346 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4d2bd0df-0166-4923-ba8e-dad8c15d36c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:51.320326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4d2bd0df-0166-4923-ba8e-dad8c15d36c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:51.321985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4d2bd0df-0166-4923-ba8e-dad8c15d36c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:51.323135 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4d2bd0df-0166-4923-ba8e-dad8c15d36c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1406 microversion: 2.20 time: 0.218429 Sep 09 13:16:51.324354 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 161/320] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:51 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:16:51.437267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-65f2e9c7-f813-4d74-8988-7b065ab37c4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:51.448110 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-65f2e9c7-f813-4d74-8988-7b065ab37c4e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.480215 Sep 09 13:16:51.449279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 160/321] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:50 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:52.355521 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-06f47611-71fe-493c-b92e-5eafd3e78114 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:52.356461 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-06f47611-71fe-493c-b92e-5eafd3e78114 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:52.366432 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-06f47611-71fe-493c-b92e-5eafd3e78114 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:52.367219 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-06f47611-71fe-493c-b92e-5eafd3e78114 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:52.367893 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-06f47611-71fe-493c-b92e-5eafd3e78114 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:52.368808 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-06f47611-71fe-493c-b92e-5eafd3e78114 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:52.369254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-06f47611-71fe-493c-b92e-5eafd3e78114 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:52.369680 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-06f47611-71fe-493c-b92e-5eafd3e78114 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:52.476420 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0e6e9b18-dec1-42aa-8a2d-01a249f26e21 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:52.477093 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0e6e9b18-dec1-42aa-8a2d-01a249f26e21 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:52.493873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e6e9b18-dec1-42aa-8a2d-01a249f26e21 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:52.494442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e6e9b18-dec1-42aa-8a2d-01a249f26e21 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:52.494928 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e6e9b18-dec1-42aa-8a2d-01a249f26e21 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:52.496034 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e6e9b18-dec1-42aa-8a2d-01a249f26e21 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:52.496148 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e6e9b18-dec1-42aa-8a2d-01a249f26e21 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:52.497103 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0e6e9b18-dec1-42aa-8a2d-01a249f26e21 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:52.580557 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-06f47611-71fe-493c-b92e-5eafd3e78114 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:52.619456 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-06f47611-71fe-493c-b92e-5eafd3e78114 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:52.623196 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-06f47611-71fe-493c-b92e-5eafd3e78114 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:52.634388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-06f47611-71fe-493c-b92e-5eafd3e78114 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1406 microversion: 2.20 time: 0.282548 Sep 09 13:16:52.635987 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 162/322] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:52 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:16:52.782268 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0e6e9b18-dec1-42aa-8a2d-01a249f26e21 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:52.800633 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0e6e9b18-dec1-42aa-8a2d-01a249f26e21 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.329740 Sep 09 13:16:52.802918 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 161/323] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:52 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:53.661720 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cdf7ec21-4e0c-4d49-8ab3-de0f3fa86a70 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:53.662955 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cdf7ec21-4e0c-4d49-8ab3-de0f3fa86a70 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:53.671676 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cdf7ec21-4e0c-4d49-8ab3-de0f3fa86a70 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:53.672438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cdf7ec21-4e0c-4d49-8ab3-de0f3fa86a70 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:53.672876 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cdf7ec21-4e0c-4d49-8ab3-de0f3fa86a70 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:53.673902 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cdf7ec21-4e0c-4d49-8ab3-de0f3fa86a70 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:53.674517 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cdf7ec21-4e0c-4d49-8ab3-de0f3fa86a70 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:53.675127 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cdf7ec21-4e0c-4d49-8ab3-de0f3fa86a70 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:53.829703 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6065b189-0a79-44e2-ace6-584c32658e7c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:53.830625 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6065b189-0a79-44e2-ace6-584c32658e7c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:53.841250 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6065b189-0a79-44e2-ace6-584c32658e7c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:53.842102 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6065b189-0a79-44e2-ace6-584c32658e7c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:53.842785 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6065b189-0a79-44e2-ace6-584c32658e7c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:53.843755 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6065b189-0a79-44e2-ace6-584c32658e7c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:53.844611 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6065b189-0a79-44e2-ace6-584c32658e7c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:53.845245 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6065b189-0a79-44e2-ace6-584c32658e7c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:53.857654 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-cdf7ec21-4e0c-4d49-8ab3-de0f3fa86a70 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:53.881205 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-cdf7ec21-4e0c-4d49-8ab3-de0f3fa86a70 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:53.887586 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-cdf7ec21-4e0c-4d49-8ab3-de0f3fa86a70 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:53.889125 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cdf7ec21-4e0c-4d49-8ab3-de0f3fa86a70 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1599 microversion: 2.20 time: 0.231192 Sep 09 13:16:53.892803 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 163/324] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:16:53 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1599 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:16:53.920340 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-65caa68e-68ee-4d03-8ea5-a80e158278fb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:53.920917 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-65caa68e-68ee-4d03-8ea5-a80e158278fb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:53.938034 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65caa68e-68ee-4d03-8ea5-a80e158278fb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:53.938765 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65caa68e-68ee-4d03-8ea5-a80e158278fb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:53.940487 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65caa68e-68ee-4d03-8ea5-a80e158278fb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:53.941463 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65caa68e-68ee-4d03-8ea5-a80e158278fb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:53.945161 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65caa68e-68ee-4d03-8ea5-a80e158278fb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:53.946109 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65caa68e-68ee-4d03-8ea5-a80e158278fb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:54.089065 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-65caa68e-68ee-4d03-8ea5-a80e158278fb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.174446 Sep 09 13:16:54.091316 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 164/325] 10.222.0.17 () {60 vars in 1316 bytes} [Fri Sep 9 13:16:53 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-interface => generated 285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:16:54.237397 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6065b189-0a79-44e2-ace6-584c32658e7c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:54.277100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6065b189-0a79-44e2-ace6-584c32658e7c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.451406 Sep 09 13:16:54.279608 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 162/326] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:53 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:54.785646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b03f0f40-f5ee-411c-a8ac-efb4f98887cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:54.797942 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b03f0f40-f5ee-411c-a8ac-efb4f98887cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:54.799223 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b03f0f40-f5ee-411c-a8ac-efb4f98887cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:54.800294 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b03f0f40-f5ee-411c-a8ac-efb4f98887cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:54.916062 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b03f0f40-f5ee-411c-a8ac-efb4f98887cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Going to try to stop instance {{(pid=120623) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 13:16:54.983984 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b03f0f40-f5ee-411c-a8ac-efb4f98887cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "POST /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/action" status: 202 len: 0 microversion: 2.1 time: 0.204066 Sep 09 13:16:54.989983 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 165/327] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 13:16:54 2022] POST /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:16:54.996327 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-61b51ece-2d7c-4774-81d3-ca9ca1050db1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:54.998337 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-61b51ece-2d7c-4774-81d3-ca9ca1050db1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:55.008416 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61b51ece-2d7c-4774-81d3-ca9ca1050db1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:55.010819 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61b51ece-2d7c-4774-81d3-ca9ca1050db1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:55.012831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61b51ece-2d7c-4774-81d3-ca9ca1050db1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:55.013836 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61b51ece-2d7c-4774-81d3-ca9ca1050db1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:55.016350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61b51ece-2d7c-4774-81d3-ca9ca1050db1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:55.020039 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61b51ece-2d7c-4774-81d3-ca9ca1050db1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:55.309042 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-662dbf94-1da2-47ec-875b-a033b6f4c585 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:55.309668 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-662dbf94-1da2-47ec-875b-a033b6f4c585 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:55.324923 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-662dbf94-1da2-47ec-875b-a033b6f4c585 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:55.325467 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-662dbf94-1da2-47ec-875b-a033b6f4c585 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:55.325915 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-662dbf94-1da2-47ec-875b-a033b6f4c585 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:55.326989 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-662dbf94-1da2-47ec-875b-a033b6f4c585 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:55.329029 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-662dbf94-1da2-47ec-875b-a033b6f4c585 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:55.330086 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-662dbf94-1da2-47ec-875b-a033b6f4c585 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:55.413802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-61b51ece-2d7c-4774-81d3-ca9ca1050db1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:55.427745 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-61b51ece-2d7c-4774-81d3-ca9ca1050db1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1723 microversion: 2.1 time: 0.435468 Sep 09 13:16:55.429887 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 163/328] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:54 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1723 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:55.791949 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-662dbf94-1da2-47ec-875b-a033b6f4c585 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:55.803515 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-662dbf94-1da2-47ec-875b-a033b6f4c585 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1501 microversion: 2.1 time: 0.500803 Sep 09 13:16:55.804275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 166/329] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:55 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1501 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:16:55.829715 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4fb2c182-74c4-4297-b268-f3664b36b826 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c958f64-8c08-49c6-9850-32f065e2e020"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:55.832382 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4fb2c182-74c4-4297-b268-f3664b36b826 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:55.839514 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fb2c182-74c4-4297-b268-f3664b36b826 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:55.840661 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fb2c182-74c4-4297-b268-f3664b36b826 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:55.841366 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fb2c182-74c4-4297-b268-f3664b36b826 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:55.842153 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fb2c182-74c4-4297-b268-f3664b36b826 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:55.842695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fb2c182-74c4-4297-b268-f3664b36b826 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:55.843233 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4fb2c182-74c4-4297-b268-f3664b36b826 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:55.870201 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-4fb2c182-74c4-4297-b268-f3664b36b826 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] HTTP exception thrown: Cannot 'attach_volume' instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 while it is in vm_state rescued Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4fb2c182-74c4-4297-b268-f3664b36b826 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Request method failure captured: Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: POST /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39/os-volume_attachments HTTP/1.1 Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 74 Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzxMaP5VQ9Fa4ImIgAfQPE2uyEKzPqrSzG7jDqHVKheNPr4YU7dLoJPAu1rRTBsxWJj2PugBC5JGZ6kf7tsaYSTWABRQuj-o4spLAESfpGmqV5VvqtmG6FoGDvekFdSvHcYXGJy8g3zxH-DAzraEBEuS_8Rx758zmWkj4bVIt3J4Dcs Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 1eedefa6b656409f902d158e77d94aa0 Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:16:55.873449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:16:55.874988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1eedefa6b656409f902d158e77d94aa0", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:16:55.874988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:16:55.874988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 1eedefa6b656409f902d158e77d94aa0 Sep 09 13:16:55.874988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:16:55.874988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-ServerRescueNegativeTestJSON-819143313-project Sep 09 13:16:55.874988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:16:55.874988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:16:55.874988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: 21700a3c2ff24fc6a3bb5db8bf283f5c Sep 09 13:16:55.874988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-ServerRescueNegativeTestJSON-819143313-project Sep 09 13:16:55.874988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Sep 09 13:16:55.874988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {"volumeAttachment": {"volumeId": "2c958f64-8c08-49c6-9850-32f065e2e020"}} Sep 09 13:16:55.874988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Cannot 'attach_volume' instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 while it is in vm_state rescued Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'server_id': '6b9110cf-907a-46bc-8e9d-31dd3c409e39', 'body': {'volumeAttachment': {'volumeId': '2c958f64-8c08-49c6-9850-32f065e2e020'}}} Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:16:55.876279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 while it is in vm_state rescued Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:16:55.877700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:16:55.879122 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:16:55.879122 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:16:55.879122 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 while it is in vm_state rescued Sep 09 13:16:55.879122 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:16:55.879122 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4fb2c182-74c4-4297-b268-f3664b36b826 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Returning 409 to user: Cannot 'attach_volume' instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 while it is in vm_state rescued {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:16:55.879122 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4fb2c182-74c4-4297-b268-f3664b36b826 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "POST /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051956 Sep 09 13:16:55.881803 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 164/330] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 13:16:55 2022] POST /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39/os-volume_attachments => generated 152 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 13:16:55.886435 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-07d0b55f-e528-45b0-86bb-c51c06cf90f6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:55.888008 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-07d0b55f-e528-45b0-86bb-c51c06cf90f6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:55.894900 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-07d0b55f-e528-45b0-86bb-c51c06cf90f6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:55.898399 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-07d0b55f-e528-45b0-86bb-c51c06cf90f6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:55.898865 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-07d0b55f-e528-45b0-86bb-c51c06cf90f6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:55.900840 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-07d0b55f-e528-45b0-86bb-c51c06cf90f6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:55.902488 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-07d0b55f-e528-45b0-86bb-c51c06cf90f6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:55.902953 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-07d0b55f-e528-45b0-86bb-c51c06cf90f6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:55.988541 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-07d0b55f-e528-45b0-86bb-c51c06cf90f6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "POST /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39/action" status: 202 len: 0 microversion: 2.1 time: 0.105644 Sep 09 13:16:55.991635 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 167/331] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 13:16:55 2022] POST /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 13:16:56.000160 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-780e01c5-1a71-4194-8619-2adc9f08fbee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:56.000782 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-780e01c5-1a71-4194-8619-2adc9f08fbee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:56.011413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-780e01c5-1a71-4194-8619-2adc9f08fbee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:56.012000 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-780e01c5-1a71-4194-8619-2adc9f08fbee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:56.012908 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-780e01c5-1a71-4194-8619-2adc9f08fbee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:56.013660 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-780e01c5-1a71-4194-8619-2adc9f08fbee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:56.014118 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-780e01c5-1a71-4194-8619-2adc9f08fbee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:56.014541 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-780e01c5-1a71-4194-8619-2adc9f08fbee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:56.091736 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-a1cbf4aa-3b94-48bc-b26c-1bd764e245c3 req-54bc66ff-18b2-49e2-9108-988610250d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f961e5a-6c12-48b6-ae52-e61b993275b3", "tag": "b38055a2-318f-4ddd-8392-48b0e32eee23"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:16:56.114113 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-a1cbf4aa-3b94-48bc-b26c-1bd764e245c3 req-54bc66ff-18b2-49e2-9108-988610250d95 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:56.117610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-a1cbf4aa-3b94-48bc-b26c-1bd764e245c3 req-54bc66ff-18b2-49e2-9108-988610250d95 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:56.118710 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-a1cbf4aa-3b94-48bc-b26c-1bd764e245c3 req-54bc66ff-18b2-49e2-9108-988610250d95 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:56.144547 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-a1cbf4aa-3b94-48bc-b26c-1bd764e245c3 req-54bc66ff-18b2-49e2-9108-988610250d95 service nova] Creating event network-changed:b38055a2-318f-4ddd-8392-48b0e32eee23 for instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 on hv-cinder-83124 Sep 09 13:16:56.173810 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-a1cbf4aa-3b94-48bc-b26c-1bd764e245c3 req-54bc66ff-18b2-49e2-9108-988610250d95 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088454 Sep 09 13:16:56.178903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 168/332] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:16:56.461330 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6ea2f6e2-25da-47d7-a54c-6527654b729f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:56.462438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6ea2f6e2-25da-47d7-a54c-6527654b729f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:56.480511 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6ea2f6e2-25da-47d7-a54c-6527654b729f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:56.482704 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6ea2f6e2-25da-47d7-a54c-6527654b729f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:56.485529 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6ea2f6e2-25da-47d7-a54c-6527654b729f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:56.486537 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6ea2f6e2-25da-47d7-a54c-6527654b729f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:56.488429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6ea2f6e2-25da-47d7-a54c-6527654b729f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:56.491817 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6ea2f6e2-25da-47d7-a54c-6527654b729f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:56.692247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-780e01c5-1a71-4194-8619-2adc9f08fbee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:56.707110 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-780e01c5-1a71-4194-8619-2adc9f08fbee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1509 microversion: 2.1 time: 0.712355 Sep 09 13:16:56.709328 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 165/333] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:55 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1509 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:57.081378 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6ea2f6e2-25da-47d7-a54c-6527654b729f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:57.091111 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6ea2f6e2-25da-47d7-a54c-6527654b729f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1723 microversion: 2.1 time: 0.636566 Sep 09 13:16:57.118272 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 169/334] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:56 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1723 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:57.735677 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-80b7a81b-efb2-4609-a2a0-59502c0e2106 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:57.736623 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-80b7a81b-efb2-4609-a2a0-59502c0e2106 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:57.757560 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80b7a81b-efb2-4609-a2a0-59502c0e2106 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:57.758491 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80b7a81b-efb2-4609-a2a0-59502c0e2106 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:57.759228 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80b7a81b-efb2-4609-a2a0-59502c0e2106 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:57.760151 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80b7a81b-efb2-4609-a2a0-59502c0e2106 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:57.760600 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80b7a81b-efb2-4609-a2a0-59502c0e2106 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:57.761046 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80b7a81b-efb2-4609-a2a0-59502c0e2106 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:57.946036 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-80b7a81b-efb2-4609-a2a0-59502c0e2106 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:57.955748 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-80b7a81b-efb2-4609-a2a0-59502c0e2106 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1509 microversion: 2.1 time: 0.225562 Sep 09 13:16:57.956749 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 166/335] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:57 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:58.128022 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2c95ac71-9dc3-408c-b575-da785bf74792 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:58.130263 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2c95ac71-9dc3-408c-b575-da785bf74792 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:58.144426 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c95ac71-9dc3-408c-b575-da785bf74792 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:58.145415 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c95ac71-9dc3-408c-b575-da785bf74792 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:58.146485 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c95ac71-9dc3-408c-b575-da785bf74792 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:58.147578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c95ac71-9dc3-408c-b575-da785bf74792 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:58.148678 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c95ac71-9dc3-408c-b575-da785bf74792 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:58.149349 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c95ac71-9dc3-408c-b575-da785bf74792 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:58.305496 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2c95ac71-9dc3-408c-b575-da785bf74792 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:58.315913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2c95ac71-9dc3-408c-b575-da785bf74792 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1723 microversion: 2.1 time: 0.197988 Sep 09 13:16:58.316924 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 170/336] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:58 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:58.979924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-27dd2ae7-ae89-4537-85d1-d28265003bc6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:58.980761 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-27dd2ae7-ae89-4537-85d1-d28265003bc6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:58.987955 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27dd2ae7-ae89-4537-85d1-d28265003bc6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:58.988442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27dd2ae7-ae89-4537-85d1-d28265003bc6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:58.988881 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27dd2ae7-ae89-4537-85d1-d28265003bc6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:58.989666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27dd2ae7-ae89-4537-85d1-d28265003bc6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:58.990479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27dd2ae7-ae89-4537-85d1-d28265003bc6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:58.990910 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-27dd2ae7-ae89-4537-85d1-d28265003bc6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:59.130329 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-27dd2ae7-ae89-4537-85d1-d28265003bc6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:59.139650 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-27dd2ae7-ae89-4537-85d1-d28265003bc6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1509 microversion: 2.1 time: 0.163738 Sep 09 13:16:59.140407 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 167/337] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:58 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:16:59.340375 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-af3e1720-8b60-4de7-8332-634700559317 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:16:59.340948 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-af3e1720-8b60-4de7-8332-634700559317 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:16:59.347802 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-af3e1720-8b60-4de7-8332-634700559317 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:59.348316 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-af3e1720-8b60-4de7-8332-634700559317 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:59.348768 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-af3e1720-8b60-4de7-8332-634700559317 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:59.349467 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-af3e1720-8b60-4de7-8332-634700559317 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:16:59.349932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-af3e1720-8b60-4de7-8332-634700559317 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:16:59.350551 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-af3e1720-8b60-4de7-8332-634700559317 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:16:59.499926 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-af3e1720-8b60-4de7-8332-634700559317 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:16:59.502734 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:16:59.532007 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-af3e1720-8b60-4de7-8332-634700559317 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1723 microversion: 2.1 time: 0.194561 Sep 09 13:16:59.532007 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 171/338] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:16:59 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:00.163321 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b639c2d-51f1-419f-acdd-7d372201f00b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:00.164064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2b639c2d-51f1-419f-acdd-7d372201f00b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:00.171546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b639c2d-51f1-419f-acdd-7d372201f00b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:00.172037 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b639c2d-51f1-419f-acdd-7d372201f00b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:00.172477 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b639c2d-51f1-419f-acdd-7d372201f00b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:00.173203 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b639c2d-51f1-419f-acdd-7d372201f00b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:00.173660 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b639c2d-51f1-419f-acdd-7d372201f00b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:00.174090 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b639c2d-51f1-419f-acdd-7d372201f00b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:00.325898 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2b639c2d-51f1-419f-acdd-7d372201f00b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:00.335751 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b639c2d-51f1-419f-acdd-7d372201f00b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1509 microversion: 2.1 time: 0.176105 Sep 09 13:17:00.336727 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 168/339] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:00 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:00.557665 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-681c6897-6643-4063-9d6a-1dd2a8470ceb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:00.560068 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-681c6897-6643-4063-9d6a-1dd2a8470ceb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:00.568926 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-681c6897-6643-4063-9d6a-1dd2a8470ceb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:00.569534 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-681c6897-6643-4063-9d6a-1dd2a8470ceb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:00.570481 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-681c6897-6643-4063-9d6a-1dd2a8470ceb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:00.571428 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-681c6897-6643-4063-9d6a-1dd2a8470ceb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:00.572274 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-681c6897-6643-4063-9d6a-1dd2a8470ceb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:00.572711 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-681c6897-6643-4063-9d6a-1dd2a8470ceb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:00.740920 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-681c6897-6643-4063-9d6a-1dd2a8470ceb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:00.750286 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-681c6897-6643-4063-9d6a-1dd2a8470ceb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1723 microversion: 2.1 time: 0.197490 Sep 09 13:17:00.750985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 172/340] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:00 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:01.360891 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-90e96e62-7c79-4fd8-8f1c-5dbc7740bb85 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:01.361784 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-90e96e62-7c79-4fd8-8f1c-5dbc7740bb85 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:01.369068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90e96e62-7c79-4fd8-8f1c-5dbc7740bb85 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:01.369549 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90e96e62-7c79-4fd8-8f1c-5dbc7740bb85 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:01.369980 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90e96e62-7c79-4fd8-8f1c-5dbc7740bb85 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:01.370671 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90e96e62-7c79-4fd8-8f1c-5dbc7740bb85 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:01.371664 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90e96e62-7c79-4fd8-8f1c-5dbc7740bb85 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:01.372315 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-90e96e62-7c79-4fd8-8f1c-5dbc7740bb85 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:01.520542 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-90e96e62-7c79-4fd8-8f1c-5dbc7740bb85 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:01.529663 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:01.532688 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-90e96e62-7c79-4fd8-8f1c-5dbc7740bb85 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1515 microversion: 2.1 time: 0.176262 Sep 09 13:17:01.533411 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 169/341] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:01 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:01.774303 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-38c7272f-a991-4786-991e-983dca28a0cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:01.775206 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-38c7272f-a991-4786-991e-983dca28a0cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:01.786936 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38c7272f-a991-4786-991e-983dca28a0cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:01.788069 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38c7272f-a991-4786-991e-983dca28a0cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:01.788690 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38c7272f-a991-4786-991e-983dca28a0cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:01.790255 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38c7272f-a991-4786-991e-983dca28a0cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:01.790879 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38c7272f-a991-4786-991e-983dca28a0cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:01.791585 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38c7272f-a991-4786-991e-983dca28a0cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:01.858249 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bcc9ded7-b899-4b10-8590-52e25f620efb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Action: 'create', calling method: .version_select at 0x7fd4a19cd430>, body: {"keypair": {"name": "tempest-keypair-269040525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElegZjtlO6EdwFqdWLBbTk2YHbrc2YLcTL2ncyOY6VyRBHDSx8XIjloGf1uH3VycDaM+Cm08ANtv71yDE2eTsY1PmRRJAAVNPRqXOY9tt5NNWFkIcPf4MI66KJ9YbfF3Q=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:17:01.885155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-bcc9ded7-b899-4b10-8590-52e25f620efb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:17:01.896868 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-bcc9ded7-b899-4b10-8590-52e25f620efb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for user dcb88983a8e1439588644b71170d7362 and project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:17:01.968327 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bcc9ded7-b899-4b10-8590-52e25f620efb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116473 Sep 09 13:17:01.974427 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 170/342] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 13:17:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:17:02.045733 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-38c7272f-a991-4786-991e-983dca28a0cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:02.054276 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-38c7272f-a991-4786-991e-983dca28a0cd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1723 microversion: 2.1 time: 0.284261 Sep 09 13:17:02.054960 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 173/343] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:01 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:03.092494 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-748f18f4-f6d5-456e-a0a5-d6ee605c128c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Action: 'create', calling method: .version_select at 0x7fd4a19cd9d0>, body: {"keypair": {"name": "tempest-keypair-322814798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFb8sI08ysYaxlGCrv0sAPiDt2raFsSmMw31AwWQQT21t+ejmJlGCnri8vWe4APVjvgENOjvtMi5A74U0CFPsb8XyZxMQgutLwiPPb/Fy1Yeq0m7luODGQ3+WnVjhkq/1w=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:17:03.096088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5196e1a8-32fe-4798-b0dc-70f8908fbec1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:03.096607 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5196e1a8-32fe-4798-b0dc-70f8908fbec1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:03.109314 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5196e1a8-32fe-4798-b0dc-70f8908fbec1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:03.109821 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5196e1a8-32fe-4798-b0dc-70f8908fbec1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:03.110275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5196e1a8-32fe-4798-b0dc-70f8908fbec1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:03.110996 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5196e1a8-32fe-4798-b0dc-70f8908fbec1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:03.113862 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5196e1a8-32fe-4798-b0dc-70f8908fbec1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:03.113862 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5196e1a8-32fe-4798-b0dc-70f8908fbec1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:03.147723 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-748f18f4-f6d5-456e-a0a5-d6ee605c128c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Getting quotas for project 1eedefa6b656409f902d158e77d94aa0. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:17:03.152273 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-748f18f4-f6d5-456e-a0a5-d6ee605c128c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Getting quotas for user 21700a3c2ff24fc6a3bb5db8bf283f5c and project 1eedefa6b656409f902d158e77d94aa0. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:17:03.205299 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-748f18f4-f6d5-456e-a0a5-d6ee605c128c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126259 Sep 09 13:17:03.206339 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 171/344] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 13:17:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:17:03.493961 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5196e1a8-32fe-4798-b0dc-70f8908fbec1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:03.506947 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5196e1a8-32fe-4798-b0dc-70f8908fbec1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1723 microversion: 2.1 time: 0.420098 Sep 09 13:17:03.511484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 174/345] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:03 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1723 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:03.878423 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1064376955", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2956cf21-dbaf-41ce-8ac8-8e3d7c788d07"}], "security_groups": [{"name": "tempest-securitygroup--1768746834"}], "key_name": "tempest-keypair-269040525", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:17:04.534747 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-35427d42-1f52-41ff-891e-d3cf435e2bf8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:04.536031 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-35427d42-1f52-41ff-891e-d3cf435e2bf8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:04.543137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:04.548289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35427d42-1f52-41ff-891e-d3cf435e2bf8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:04.553858 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35427d42-1f52-41ff-891e-d3cf435e2bf8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:04.554085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35427d42-1f52-41ff-891e-d3cf435e2bf8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:04.557711 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35427d42-1f52-41ff-891e-d3cf435e2bf8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:04.558198 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35427d42-1f52-41ff-891e-d3cf435e2bf8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:04.558704 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35427d42-1f52-41ff-891e-d3cf435e2bf8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:04.756753 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-35427d42-1f52-41ff-891e-d3cf435e2bf8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:04.769266 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-35427d42-1f52-41ff-891e-d3cf435e2bf8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1723 microversion: 2.1 time: 0.238363 Sep 09 13:17:04.770350 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 175/346] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:04 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:05.324999 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-496146821", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35f83991-e6e5-4bd4-8a1f-6fb94f31874e"}], "security_groups": [{"name": "tempest-securitygroup--483190744"}], "key_name": "tempest-keypair-322814798", "user_data": "}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:17:09.354161 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] validate_networks() for [('2956cf21-dbaf-41ce-8ac8-8e3d7c788d07', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:17:09.415912 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] validate_networks() for [('35f83991-e6e5-4bd4-8a1f-6fb94f31874e', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:17:09.884899 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:17:09.885634 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:17:09.886354 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:17:09.887878 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:17:09.888699 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:17:09.911791 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:09.912671 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:09.913124 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:09.913956 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:09.914412 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:09.914869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:09.959704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:17:09.968595 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for user dcb88983a8e1439588644b71170d7362 and project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:17:09.992962 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:17:09.995559 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:17:10.131492 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cee34f5c-cade-4149-aa59-932dcd8112f8 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.257979 Sep 09 13:17:10.140139 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 172/347] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:17:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 6268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:17:10.147868 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-00c0cf81-3489-4a26-8fb8-85692cee2642 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:10.149187 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-00c0cf81-3489-4a26-8fb8-85692cee2642 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:10.160457 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00c0cf81-3489-4a26-8fb8-85692cee2642 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:10.161563 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00c0cf81-3489-4a26-8fb8-85692cee2642 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:10.162404 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00c0cf81-3489-4a26-8fb8-85692cee2642 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:10.163575 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00c0cf81-3489-4a26-8fb8-85692cee2642 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:10.164487 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00c0cf81-3489-4a26-8fb8-85692cee2642 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:10.165487 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00c0cf81-3489-4a26-8fb8-85692cee2642 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:10.285289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:17:10.286251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:17:10.286900 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:17:10.287511 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:17:10.288102 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:17:10.299527 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:10.303206 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:10.303660 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:10.304433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:10.304896 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:10.305325 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:10.406469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Getting quotas for project 1eedefa6b656409f902d158e77d94aa0. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:17:10.412246 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Getting quotas for user 21700a3c2ff24fc6a3bb5db8bf283f5c and project 1eedefa6b656409f902d158e77d94aa0. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:17:10.428022 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:17:10.431991 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:17:10.479641 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-00c0cf81-3489-4a26-8fb8-85692cee2642 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:10.491571 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-00c0cf81-3489-4a26-8fb8-85692cee2642 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1723 microversion: 2.1 time: 0.349773 Sep 09 13:17:10.492424 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 173/348] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:10 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:10.513132 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8cc78560-fe3f-4857-bcc5-8169ccc48885 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 5.192184 Sep 09 13:17:10.514310 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 176/349] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:17:05 2022] POST /compute/v2.1/servers => generated 408 bytes in 5194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 13:17:10.531462 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c29d6a34-1964-4bf0-abc2-fe8daaeaf7c9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:10.533811 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c29d6a34-1964-4bf0-abc2-fe8daaeaf7c9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:10.546103 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-87199a40-29b1-420b-924e-551ed7bc5b9f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:10.547819 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-87199a40-29b1-420b-924e-551ed7bc5b9f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:10.662174 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-87199a40-29b1-420b-924e-551ed7bc5b9f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:10.682045 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-87199a40-29b1-420b-924e-551ed7bc5b9f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1244 microversion: 2.1 time: 0.146628 Sep 09 13:17:10.684880 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 177/350] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:10 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1244 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:10.720592 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c29d6a34-1964-4bf0-abc2-fe8daaeaf7c9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:10.738481 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c29d6a34-1964-4bf0-abc2-fe8daaeaf7c9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1241 microversion: 2.1 time: 0.237890 Sep 09 13:17:10.739490 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 174/351] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:10 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1241 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:11.521938 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-618fde59-fef5-4083-a9c8-fb7a7ee15713 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:11.522690 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-618fde59-fef5-4083-a9c8-fb7a7ee15713 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:11.531492 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-618fde59-fef5-4083-a9c8-fb7a7ee15713 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:11.531975 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-618fde59-fef5-4083-a9c8-fb7a7ee15713 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:11.532495 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-618fde59-fef5-4083-a9c8-fb7a7ee15713 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:11.533298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-618fde59-fef5-4083-a9c8-fb7a7ee15713 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:11.533793 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-618fde59-fef5-4083-a9c8-fb7a7ee15713 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:11.534350 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-618fde59-fef5-4083-a9c8-fb7a7ee15713 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:11.685585 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-618fde59-fef5-4083-a9c8-fb7a7ee15713 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:11.694059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-618fde59-fef5-4083-a9c8-fb7a7ee15713 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1700 microversion: 2.1 time: 0.177064 Sep 09 13:17:11.694622 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 178/352] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:11 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1700 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:11.716418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-164cad74-998d-4c38-8ca1-d39966a11326 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:11.717655 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-164cad74-998d-4c38-8ca1-d39966a11326 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:11.720056 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e08b87c4-61b2-49c0-878f-b74292f0be25 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:17:11.725353 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-164cad74-998d-4c38-8ca1-d39966a11326 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:11.726119 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-164cad74-998d-4c38-8ca1-d39966a11326 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:11.726772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-164cad74-998d-4c38-8ca1-d39966a11326 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:11.727547 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e08b87c4-61b2-49c0-878f-b74292f0be25 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:11.727870 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-164cad74-998d-4c38-8ca1-d39966a11326 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:11.728041 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e08b87c4-61b2-49c0-878f-b74292f0be25 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:11.728484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e08b87c4-61b2-49c0-878f-b74292f0be25 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:11.728797 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-164cad74-998d-4c38-8ca1-d39966a11326 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:11.729367 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-164cad74-998d-4c38-8ca1-d39966a11326 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:11.757839 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e08b87c4-61b2-49c0-878f-b74292f0be25 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Going to try to start instance {{(pid=120623) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 13:17:11.819868 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-164cad74-998d-4c38-8ca1-d39966a11326 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:11.828642 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-164cad74-998d-4c38-8ca1-d39966a11326 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1240 microversion: 2.1 time: 0.116313 Sep 09 13:17:11.843618 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 175/353] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:11 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1240 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:11.849912 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e08b87c4-61b2-49c0-878f-b74292f0be25 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "POST /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/action" status: 202 len: 0 microversion: 2.1 time: 0.134806 Sep 09 13:17:11.853293 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c6b19b42-5682-4466-adf3-d6f6189b5675 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:11.854209 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c6b19b42-5682-4466-adf3-d6f6189b5675 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:11.858124 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 179/354] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 13:17:11 2022] POST /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 13:17:11.864640 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8534a70e-d4d7-4d61-9211-c70632677f99 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:11.865881 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8534a70e-d4d7-4d61-9211-c70632677f99 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:11.872313 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6b19b42-5682-4466-adf3-d6f6189b5675 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:11.873701 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6b19b42-5682-4466-adf3-d6f6189b5675 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:11.874283 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6b19b42-5682-4466-adf3-d6f6189b5675 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:11.875320 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8534a70e-d4d7-4d61-9211-c70632677f99 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:11.875827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6b19b42-5682-4466-adf3-d6f6189b5675 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:11.876190 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8534a70e-d4d7-4d61-9211-c70632677f99 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:11.876769 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8534a70e-d4d7-4d61-9211-c70632677f99 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:11.877247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6b19b42-5682-4466-adf3-d6f6189b5675 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:11.878057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6b19b42-5682-4466-adf3-d6f6189b5675 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:11.878190 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8534a70e-d4d7-4d61-9211-c70632677f99 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:11.878757 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8534a70e-d4d7-4d61-9211-c70632677f99 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:11.879268 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8534a70e-d4d7-4d61-9211-c70632677f99 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:11.991316 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c6b19b42-5682-4466-adf3-d6f6189b5675 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:12.008156 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c6b19b42-5682-4466-adf3-d6f6189b5675 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1293 microversion: 2.1 time: 0.163109 Sep 09 13:17:12.015981 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 176/355] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:11 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1293 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:12.241053 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8534a70e-d4d7-4d61-9211-c70632677f99 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:12.255881 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8534a70e-d4d7-4d61-9211-c70632677f99 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1709 microversion: 2.1 time: 0.396060 Sep 09 13:17:12.256843 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 180/356] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:11 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1709 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:12.859150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-37be53cd-0aa6-456e-886d-5feaebece10d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:12.860042 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-37be53cd-0aa6-456e-886d-5feaebece10d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:12.870789 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:12.885484 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37be53cd-0aa6-456e-886d-5feaebece10d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:12.886169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37be53cd-0aa6-456e-886d-5feaebece10d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:12.889528 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37be53cd-0aa6-456e-886d-5feaebece10d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:12.890411 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37be53cd-0aa6-456e-886d-5feaebece10d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:12.893150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37be53cd-0aa6-456e-886d-5feaebece10d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:12.894270 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-37be53cd-0aa6-456e-886d-5feaebece10d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:13.066254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-372bafce-9704-4e17-9e5e-3a7d811c17b9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:13.069473 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-372bafce-9704-4e17-9e5e-3a7d811c17b9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:13.081154 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-372bafce-9704-4e17-9e5e-3a7d811c17b9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:13.082506 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-372bafce-9704-4e17-9e5e-3a7d811c17b9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:13.083595 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-372bafce-9704-4e17-9e5e-3a7d811c17b9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:13.085139 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-372bafce-9704-4e17-9e5e-3a7d811c17b9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:13.086288 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-372bafce-9704-4e17-9e5e-3a7d811c17b9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:13.087412 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-372bafce-9704-4e17-9e5e-3a7d811c17b9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:13.189194 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-37be53cd-0aa6-456e-886d-5feaebece10d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:13.198324 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-37be53cd-0aa6-456e-886d-5feaebece10d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1304 microversion: 2.1 time: 0.343757 Sep 09 13:17:13.199241 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 177/357] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:12 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1304 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:13.236074 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-372bafce-9704-4e17-9e5e-3a7d811c17b9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:13.250515 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-372bafce-9704-4e17-9e5e-3a7d811c17b9 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1299 microversion: 2.1 time: 0.203444 Sep 09 13:17:13.251717 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 181/358] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:13 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1299 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:13.280997 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0ff7c18a-4ca4-4c15-a36f-54e5c5ef735a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:13.282616 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0ff7c18a-4ca4-4c15-a36f-54e5c5ef735a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:13.289748 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ff7c18a-4ca4-4c15-a36f-54e5c5ef735a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:13.290988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ff7c18a-4ca4-4c15-a36f-54e5c5ef735a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:13.291694 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ff7c18a-4ca4-4c15-a36f-54e5c5ef735a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:13.292702 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ff7c18a-4ca4-4c15-a36f-54e5c5ef735a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:13.293368 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ff7c18a-4ca4-4c15-a36f-54e5c5ef735a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:13.294249 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ff7c18a-4ca4-4c15-a36f-54e5c5ef735a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:13.498669 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0ff7c18a-4ca4-4c15-a36f-54e5c5ef735a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:13.520306 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0ff7c18a-4ca4-4c15-a36f-54e5c5ef735a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1709 microversion: 2.1 time: 0.243431 Sep 09 13:17:13.543370 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 178/359] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:13 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1709 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:14.224037 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-262a9c31-57f4-4cbc-b430-5f5e70ec1cd5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:14.225630 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-262a9c31-57f4-4cbc-b430-5f5e70ec1cd5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:14.241015 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-262a9c31-57f4-4cbc-b430-5f5e70ec1cd5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:14.241815 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-262a9c31-57f4-4cbc-b430-5f5e70ec1cd5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:14.242253 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-262a9c31-57f4-4cbc-b430-5f5e70ec1cd5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:14.242961 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-262a9c31-57f4-4cbc-b430-5f5e70ec1cd5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:14.243445 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-262a9c31-57f4-4cbc-b430-5f5e70ec1cd5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:14.243870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-262a9c31-57f4-4cbc-b430-5f5e70ec1cd5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:14.286079 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-49108d31-b9bf-4ac9-8322-63461ac78c93 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:14.290346 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-49108d31-b9bf-4ac9-8322-63461ac78c93 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:14.319902 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49108d31-b9bf-4ac9-8322-63461ac78c93 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:14.322129 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49108d31-b9bf-4ac9-8322-63461ac78c93 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:14.322978 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49108d31-b9bf-4ac9-8322-63461ac78c93 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:14.326336 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49108d31-b9bf-4ac9-8322-63461ac78c93 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:14.327357 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49108d31-b9bf-4ac9-8322-63461ac78c93 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:14.329350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-49108d31-b9bf-4ac9-8322-63461ac78c93 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:14.502143 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-49108d31-b9bf-4ac9-8322-63461ac78c93 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:14.514612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-49108d31-b9bf-4ac9-8322-63461ac78c93 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.240963 Sep 09 13:17:14.514967 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 179/360] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:14 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:14.560721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-70d3d7ba-22ec-4457-9bfa-8d72a0fae957 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:14.561671 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-70d3d7ba-22ec-4457-9bfa-8d72a0fae957 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:14.571628 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70d3d7ba-22ec-4457-9bfa-8d72a0fae957 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:14.572201 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70d3d7ba-22ec-4457-9bfa-8d72a0fae957 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:14.577895 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70d3d7ba-22ec-4457-9bfa-8d72a0fae957 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:14.577895 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70d3d7ba-22ec-4457-9bfa-8d72a0fae957 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:14.577895 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70d3d7ba-22ec-4457-9bfa-8d72a0fae957 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:14.577895 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-70d3d7ba-22ec-4457-9bfa-8d72a0fae957 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:14.653132 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-262a9c31-57f4-4cbc-b430-5f5e70ec1cd5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:14.661070 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-262a9c31-57f4-4cbc-b430-5f5e70ec1cd5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1302 microversion: 2.1 time: 0.441678 Sep 09 13:17:14.671497 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 182/361] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:14 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1302 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:14.837786 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-70d3d7ba-22ec-4457-9bfa-8d72a0fae957 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:14.848219 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-70d3d7ba-22ec-4457-9bfa-8d72a0fae957 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1709 microversion: 2.1 time: 0.292238 Sep 09 13:17:14.848889 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 180/362] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:14 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1709 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:15.540786 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e1348954-3b8c-4365-8a9d-105ef994a6c0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:15.541434 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e1348954-3b8c-4365-8a9d-105ef994a6c0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:15.547562 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1348954-3b8c-4365-8a9d-105ef994a6c0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:15.548056 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1348954-3b8c-4365-8a9d-105ef994a6c0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:15.548496 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1348954-3b8c-4365-8a9d-105ef994a6c0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:15.549186 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1348954-3b8c-4365-8a9d-105ef994a6c0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:15.549643 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1348954-3b8c-4365-8a9d-105ef994a6c0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:15.550074 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e1348954-3b8c-4365-8a9d-105ef994a6c0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:15.686409 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-811a0f41-0c9c-46ef-8e48-3b97ee5c642d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:15.687023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-811a0f41-0c9c-46ef-8e48-3b97ee5c642d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:15.694170 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-811a0f41-0c9c-46ef-8e48-3b97ee5c642d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:15.694710 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-811a0f41-0c9c-46ef-8e48-3b97ee5c642d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:15.695196 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-811a0f41-0c9c-46ef-8e48-3b97ee5c642d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:15.695915 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-811a0f41-0c9c-46ef-8e48-3b97ee5c642d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:15.696545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-811a0f41-0c9c-46ef-8e48-3b97ee5c642d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:15.697114 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-811a0f41-0c9c-46ef-8e48-3b97ee5c642d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:15.881987 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-811a0f41-0c9c-46ef-8e48-3b97ee5c642d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:15.886894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e1348954-3b8c-4365-8a9d-105ef994a6c0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:15.892086 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-811a0f41-0c9c-46ef-8e48-3b97ee5c642d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.209449 Sep 09 13:17:15.893075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 181/363] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:15 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:15.898470 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9d99ddab-a9e1-40da-8bb3-ecee65a0b2c9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:15.899389 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9d99ddab-a9e1-40da-8bb3-ecee65a0b2c9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:15.899636 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e1348954-3b8c-4365-8a9d-105ef994a6c0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.361383 Sep 09 13:17:15.906459 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d99ddab-a9e1-40da-8bb3-ecee65a0b2c9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:15.907531 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d99ddab-a9e1-40da-8bb3-ecee65a0b2c9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:15.908203 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d99ddab-a9e1-40da-8bb3-ecee65a0b2c9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:15.909137 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d99ddab-a9e1-40da-8bb3-ecee65a0b2c9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:15.909841 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d99ddab-a9e1-40da-8bb3-ecee65a0b2c9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:15.910477 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d99ddab-a9e1-40da-8bb3-ecee65a0b2c9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:15.912766 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 183/364] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:15 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:16.088955 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9d99ddab-a9e1-40da-8bb3-ecee65a0b2c9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:16.102029 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9d99ddab-a9e1-40da-8bb3-ecee65a0b2c9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1713 microversion: 2.1 time: 0.207486 Sep 09 13:17:16.102703 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 182/365] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:15 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1713 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:16.372726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-1766ce9d-997b-4a6c-86ef-1ad5911893ba req-b9322fd0-95d9-47e6-b24c-2df4cc50e755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67dfd749-af70-47be-a3de-523bc6cbd77d", "tag": "9f010fe5-2104-4a34-a352-227d3c7e2fca"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:17:16.415148 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1766ce9d-997b-4a6c-86ef-1ad5911893ba req-b9322fd0-95d9-47e6-b24c-2df4cc50e755 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:16.415639 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1766ce9d-997b-4a6c-86ef-1ad5911893ba req-b9322fd0-95d9-47e6-b24c-2df4cc50e755 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:16.416071 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1766ce9d-997b-4a6c-86ef-1ad5911893ba req-b9322fd0-95d9-47e6-b24c-2df4cc50e755 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:16.448174 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-1766ce9d-997b-4a6c-86ef-1ad5911893ba req-b9322fd0-95d9-47e6-b24c-2df4cc50e755 service nova] Creating event network-changed:9f010fe5-2104-4a34-a352-227d3c7e2fca for instance 67dfd749-af70-47be-a3de-523bc6cbd77d on hv-cinder-83124 Sep 09 13:17:16.460986 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-1766ce9d-997b-4a6c-86ef-1ad5911893ba req-b9322fd0-95d9-47e6-b24c-2df4cc50e755 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093905 Sep 09 13:17:16.464427 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 184/366] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:17:16.916466 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2860f571-dde7-4279-af2a-f695334181f2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:16.917080 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2860f571-dde7-4279-af2a-f695334181f2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:16.924752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2860f571-dde7-4279-af2a-f695334181f2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:16.925248 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2860f571-dde7-4279-af2a-f695334181f2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:16.925683 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2860f571-dde7-4279-af2a-f695334181f2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:16.926385 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2860f571-dde7-4279-af2a-f695334181f2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:16.926486 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8ddf9282-0028-40a6-9d05-9c4da9b8638f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:16.926902 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2860f571-dde7-4279-af2a-f695334181f2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:16.927289 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2860f571-dde7-4279-af2a-f695334181f2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:16.927636 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8ddf9282-0028-40a6-9d05-9c4da9b8638f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:16.936116 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ddf9282-0028-40a6-9d05-9c4da9b8638f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:16.936605 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ddf9282-0028-40a6-9d05-9c4da9b8638f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:16.937040 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ddf9282-0028-40a6-9d05-9c4da9b8638f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:16.937766 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ddf9282-0028-40a6-9d05-9c4da9b8638f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:16.938220 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ddf9282-0028-40a6-9d05-9c4da9b8638f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:16.938644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ddf9282-0028-40a6-9d05-9c4da9b8638f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:17.069762 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2860f571-dde7-4279-af2a-f695334181f2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:17.078804 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2860f571-dde7-4279-af2a-f695334181f2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.166169 Sep 09 13:17:17.079573 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 183/367] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:16 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:17.253428 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8ddf9282-0028-40a6-9d05-9c4da9b8638f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:17.262066 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8ddf9282-0028-40a6-9d05-9c4da9b8638f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.339653 Sep 09 13:17:17.262665 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 185/368] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:16 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:18.102113 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-267fd8ea-3c00-4b67-a93d-72c846b5f690 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:18.102714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-267fd8ea-3c00-4b67-a93d-72c846b5f690 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:18.109375 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-267fd8ea-3c00-4b67-a93d-72c846b5f690 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:18.109853 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-267fd8ea-3c00-4b67-a93d-72c846b5f690 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:18.110278 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-267fd8ea-3c00-4b67-a93d-72c846b5f690 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:18.110959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-267fd8ea-3c00-4b67-a93d-72c846b5f690 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:18.111434 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-267fd8ea-3c00-4b67-a93d-72c846b5f690 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:18.111850 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-267fd8ea-3c00-4b67-a93d-72c846b5f690 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:18.263670 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-267fd8ea-3c00-4b67-a93d-72c846b5f690 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:18.271493 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-267fd8ea-3c00-4b67-a93d-72c846b5f690 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.173429 Sep 09 13:17:18.272064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 184/369] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:18 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:18.284892 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5fb261ec-cd28-4924-9e37-89b2bd493134 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:18.285511 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5fb261ec-cd28-4924-9e37-89b2bd493134 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:18.294270 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5fb261ec-cd28-4924-9e37-89b2bd493134 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:18.294770 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5fb261ec-cd28-4924-9e37-89b2bd493134 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:18.295232 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5fb261ec-cd28-4924-9e37-89b2bd493134 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:18.295972 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5fb261ec-cd28-4924-9e37-89b2bd493134 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:18.296422 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5fb261ec-cd28-4924-9e37-89b2bd493134 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:18.296842 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5fb261ec-cd28-4924-9e37-89b2bd493134 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:18.435633 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5fb261ec-cd28-4924-9e37-89b2bd493134 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:18.443907 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5fb261ec-cd28-4924-9e37-89b2bd493134 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.162348 Sep 09 13:17:18.445138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 186/370] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:18 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:18.481467 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-fa5cd1f6-3f9b-4875-b357-c936ced51206 req-cbe16590-8bdf-439d-9e44-e047b37f6a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8d3e22-93f3-4251-bbfc-8bd5c60cb875", "tag": "b82ef3ba-9f78-4e05-830b-166b5fa60d7f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:17:18.490887 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fa5cd1f6-3f9b-4875-b357-c936ced51206 req-cbe16590-8bdf-439d-9e44-e047b37f6a06 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:18.491408 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fa5cd1f6-3f9b-4875-b357-c936ced51206 req-cbe16590-8bdf-439d-9e44-e047b37f6a06 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:18.491839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-fa5cd1f6-3f9b-4875-b357-c936ced51206 req-cbe16590-8bdf-439d-9e44-e047b37f6a06 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:18.503366 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-fa5cd1f6-3f9b-4875-b357-c936ced51206 req-cbe16590-8bdf-439d-9e44-e047b37f6a06 service nova] Creating event network-changed:b82ef3ba-9f78-4e05-830b-166b5fa60d7f for instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 on hv-cinder-83124 Sep 09 13:17:18.509006 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-fa5cd1f6-3f9b-4875-b357-c936ced51206 req-cbe16590-8bdf-439d-9e44-e047b37f6a06 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031185 Sep 09 13:17:18.509611 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 185/371] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:17:19.295199 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d34f6755-e5eb-4b7c-90e1-28068c217917 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:19.295757 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d34f6755-e5eb-4b7c-90e1-28068c217917 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:19.302122 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d34f6755-e5eb-4b7c-90e1-28068c217917 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:19.302602 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d34f6755-e5eb-4b7c-90e1-28068c217917 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:19.303037 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d34f6755-e5eb-4b7c-90e1-28068c217917 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:19.303742 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d34f6755-e5eb-4b7c-90e1-28068c217917 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:19.304197 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d34f6755-e5eb-4b7c-90e1-28068c217917 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:19.304623 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d34f6755-e5eb-4b7c-90e1-28068c217917 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:19.442107 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d34f6755-e5eb-4b7c-90e1-28068c217917 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:19.456325 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d34f6755-e5eb-4b7c-90e1-28068c217917 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.165350 Sep 09 13:17:19.456999 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 187/372] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:19 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:19.469498 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ab2c1f8-47f1-4529-9b92-1fb34dbcb10f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:19.470149 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ab2c1f8-47f1-4529-9b92-1fb34dbcb10f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:19.476832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab2c1f8-47f1-4529-9b92-1fb34dbcb10f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:19.477315 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab2c1f8-47f1-4529-9b92-1fb34dbcb10f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:19.477743 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab2c1f8-47f1-4529-9b92-1fb34dbcb10f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:19.478435 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab2c1f8-47f1-4529-9b92-1fb34dbcb10f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:19.478885 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab2c1f8-47f1-4529-9b92-1fb34dbcb10f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:19.479327 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab2c1f8-47f1-4529-9b92-1fb34dbcb10f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:19.618859 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ab2c1f8-47f1-4529-9b92-1fb34dbcb10f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:19.626787 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ab2c1f8-47f1-4529-9b92-1fb34dbcb10f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.162771 Sep 09 13:17:19.627381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 186/373] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:19 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:20.480879 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-58fb3012-2bc0-4321-acb2-062ace9f4dcf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:20.481494 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-58fb3012-2bc0-4321-acb2-062ace9f4dcf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:20.483899 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:20.489266 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58fb3012-2bc0-4321-acb2-062ace9f4dcf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:20.489755 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58fb3012-2bc0-4321-acb2-062ace9f4dcf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:20.490195 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58fb3012-2bc0-4321-acb2-062ace9f4dcf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:20.491175 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58fb3012-2bc0-4321-acb2-062ace9f4dcf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:20.491635 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58fb3012-2bc0-4321-acb2-062ace9f4dcf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:20.492067 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58fb3012-2bc0-4321-acb2-062ace9f4dcf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:20.626667 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-58fb3012-2bc0-4321-acb2-062ace9f4dcf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:20.634675 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-58fb3012-2bc0-4321-acb2-062ace9f4dcf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.158042 Sep 09 13:17:20.635280 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 188/374] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:20 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:20.649679 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9795ec57-e7f2-4360-980f-206734ce9430 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:20.650284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9795ec57-e7f2-4360-980f-206734ce9430 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:20.652757 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:20.658509 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9795ec57-e7f2-4360-980f-206734ce9430 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:20.658985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9795ec57-e7f2-4360-980f-206734ce9430 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:20.659448 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9795ec57-e7f2-4360-980f-206734ce9430 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:20.660130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9795ec57-e7f2-4360-980f-206734ce9430 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:20.660577 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9795ec57-e7f2-4360-980f-206734ce9430 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:20.660992 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9795ec57-e7f2-4360-980f-206734ce9430 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:20.726355 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=16 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:20.796642 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9795ec57-e7f2-4360-980f-206734ce9430 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:20.804303 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9795ec57-e7f2-4360-980f-206734ce9430 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.158532 Sep 09 13:17:20.804863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 187/375] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:20 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:21.659700 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-de47e525-5136-4287-8d58-eeeffb81020f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:21.660932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-de47e525-5136-4287-8d58-eeeffb81020f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:21.663078 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=8 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:21.669629 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de47e525-5136-4287-8d58-eeeffb81020f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:21.670120 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de47e525-5136-4287-8d58-eeeffb81020f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:21.670568 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de47e525-5136-4287-8d58-eeeffb81020f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:21.671298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de47e525-5136-4287-8d58-eeeffb81020f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:21.671760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de47e525-5136-4287-8d58-eeeffb81020f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:21.672190 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de47e525-5136-4287-8d58-eeeffb81020f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:21.828939 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8972660-5a7b-4b59-ae33-479b720adee2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:21.829482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b8972660-5a7b-4b59-ae33-479b720adee2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:21.835797 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-de47e525-5136-4287-8d58-eeeffb81020f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:21.836201 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8972660-5a7b-4b59-ae33-479b720adee2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:21.836697 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8972660-5a7b-4b59-ae33-479b720adee2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:21.837136 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8972660-5a7b-4b59-ae33-479b720adee2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:21.837872 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8972660-5a7b-4b59-ae33-479b720adee2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:21.838327 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8972660-5a7b-4b59-ae33-479b720adee2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:21.838926 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8972660-5a7b-4b59-ae33-479b720adee2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:21.842261 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:21.845690 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-de47e525-5136-4287-8d58-eeeffb81020f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.190044 Sep 09 13:17:21.846405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 189/376] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:21 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:21.994594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b8972660-5a7b-4b59-ae33-479b720adee2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:22.009969 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b8972660-5a7b-4b59-ae33-479b720adee2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.186265 Sep 09 13:17:22.019391 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 188/377] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:21 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:22.874229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-14812c05-eeb1-488a-9886-1eb21720a8bc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:22.875564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-14812c05-eeb1-488a-9886-1eb21720a8bc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:22.883964 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-14812c05-eeb1-488a-9886-1eb21720a8bc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:22.884421 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-14812c05-eeb1-488a-9886-1eb21720a8bc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:22.884868 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-14812c05-eeb1-488a-9886-1eb21720a8bc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:22.885590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-14812c05-eeb1-488a-9886-1eb21720a8bc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:22.886052 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-14812c05-eeb1-488a-9886-1eb21720a8bc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:22.886488 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-14812c05-eeb1-488a-9886-1eb21720a8bc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:23.021026 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-14812c05-eeb1-488a-9886-1eb21720a8bc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:23.028704 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-14812c05-eeb1-488a-9886-1eb21720a8bc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.159315 Sep 09 13:17:23.029272 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 190/378] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:22 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:23.033816 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f4e7e5c-06bb-455b-a511-c422ce63172d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:23.034431 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5f4e7e5c-06bb-455b-a511-c422ce63172d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:23.040905 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f4e7e5c-06bb-455b-a511-c422ce63172d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:23.041384 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f4e7e5c-06bb-455b-a511-c422ce63172d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:23.041818 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f4e7e5c-06bb-455b-a511-c422ce63172d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:23.042509 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f4e7e5c-06bb-455b-a511-c422ce63172d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:23.042991 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f4e7e5c-06bb-455b-a511-c422ce63172d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:23.043438 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f4e7e5c-06bb-455b-a511-c422ce63172d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:23.190960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5f4e7e5c-06bb-455b-a511-c422ce63172d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:23.198907 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f4e7e5c-06bb-455b-a511-c422ce63172d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.169109 Sep 09 13:17:23.199821 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 189/379] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:23 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:24.054128 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-72d07e60-4ccb-4751-a936-2ac8b36fe9c2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:24.054947 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-72d07e60-4ccb-4751-a936-2ac8b36fe9c2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:24.065174 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72d07e60-4ccb-4751-a936-2ac8b36fe9c2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:24.065964 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72d07e60-4ccb-4751-a936-2ac8b36fe9c2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:24.066467 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72d07e60-4ccb-4751-a936-2ac8b36fe9c2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:24.074916 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72d07e60-4ccb-4751-a936-2ac8b36fe9c2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:24.075447 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72d07e60-4ccb-4751-a936-2ac8b36fe9c2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:24.075894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72d07e60-4ccb-4751-a936-2ac8b36fe9c2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:24.222444 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-72d07e60-4ccb-4751-a936-2ac8b36fe9c2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:24.222708 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9dce7d7f-9710-475e-a42f-4f4a9783fc0e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:24.223350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9dce7d7f-9710-475e-a42f-4f4a9783fc0e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:24.229595 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9dce7d7f-9710-475e-a42f-4f4a9783fc0e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:24.230067 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9dce7d7f-9710-475e-a42f-4f4a9783fc0e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:24.230335 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-72d07e60-4ccb-4751-a936-2ac8b36fe9c2 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.181500 Sep 09 13:17:24.230842 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9dce7d7f-9710-475e-a42f-4f4a9783fc0e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:24.230965 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 191/380] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:24 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:24.231893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9dce7d7f-9710-475e-a42f-4f4a9783fc0e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:24.232351 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9dce7d7f-9710-475e-a42f-4f4a9783fc0e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:24.232768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9dce7d7f-9710-475e-a42f-4f4a9783fc0e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:24.373722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9dce7d7f-9710-475e-a42f-4f4a9783fc0e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:24.377400 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:24.382344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9dce7d7f-9710-475e-a42f-4f4a9783fc0e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.163352 Sep 09 13:17:24.382846 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 190/381] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:24 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:25.253796 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b50e134b-ff2f-4fd2-996c-0c60b46f3daf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:25.254413 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b50e134b-ff2f-4fd2-996c-0c60b46f3daf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:25.261068 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b50e134b-ff2f-4fd2-996c-0c60b46f3daf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:25.261620 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b50e134b-ff2f-4fd2-996c-0c60b46f3daf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:25.262010 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b50e134b-ff2f-4fd2-996c-0c60b46f3daf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:25.262686 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b50e134b-ff2f-4fd2-996c-0c60b46f3daf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:25.263173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b50e134b-ff2f-4fd2-996c-0c60b46f3daf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:25.263602 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b50e134b-ff2f-4fd2-996c-0c60b46f3daf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:25.396853 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b50e134b-ff2f-4fd2-996c-0c60b46f3daf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:25.405999 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6fafcce0-93c5-4c17-ba6b-9c5e18469276 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:25.406833 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6fafcce0-93c5-4c17-ba6b-9c5e18469276 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:25.407440 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b50e134b-ff2f-4fd2-996c-0c60b46f3daf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.157409 Sep 09 13:17:25.408032 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 192/382] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:25 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:25.413750 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fafcce0-93c5-4c17-ba6b-9c5e18469276 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:25.414312 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fafcce0-93c5-4c17-ba6b-9c5e18469276 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:25.414817 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fafcce0-93c5-4c17-ba6b-9c5e18469276 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:25.415607 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fafcce0-93c5-4c17-ba6b-9c5e18469276 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:25.416151 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fafcce0-93c5-4c17-ba6b-9c5e18469276 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:25.416640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6fafcce0-93c5-4c17-ba6b-9c5e18469276 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:25.556445 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6fafcce0-93c5-4c17-ba6b-9c5e18469276 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:25.564897 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6fafcce0-93c5-4c17-ba6b-9c5e18469276 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.162950 Sep 09 13:17:25.565459 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 191/383] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:25 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:26.431216 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9143e2b7-aeeb-4216-9fd0-8a4942eb6dc0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:26.431922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9143e2b7-aeeb-4216-9fd0-8a4942eb6dc0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:26.439538 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9143e2b7-aeeb-4216-9fd0-8a4942eb6dc0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:26.440058 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9143e2b7-aeeb-4216-9fd0-8a4942eb6dc0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:26.440492 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9143e2b7-aeeb-4216-9fd0-8a4942eb6dc0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:26.441191 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9143e2b7-aeeb-4216-9fd0-8a4942eb6dc0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:26.441646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9143e2b7-aeeb-4216-9fd0-8a4942eb6dc0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:26.442069 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9143e2b7-aeeb-4216-9fd0-8a4942eb6dc0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:26.578293 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9143e2b7-aeeb-4216-9fd0-8a4942eb6dc0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:26.586886 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-66eb233a-c6b5-4781-9210-1a79bcabc977 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:26.587530 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-66eb233a-c6b5-4781-9210-1a79bcabc977 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:26.594826 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66eb233a-c6b5-4781-9210-1a79bcabc977 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:26.595385 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66eb233a-c6b5-4781-9210-1a79bcabc977 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:26.595833 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66eb233a-c6b5-4781-9210-1a79bcabc977 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:26.596546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66eb233a-c6b5-4781-9210-1a79bcabc977 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:26.597191 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66eb233a-c6b5-4781-9210-1a79bcabc977 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:26.597615 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-66eb233a-c6b5-4781-9210-1a79bcabc977 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:26.600156 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9143e2b7-aeeb-4216-9fd0-8a4942eb6dc0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.172481 Sep 09 13:17:26.601281 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 193/384] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:26 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:26.734506 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-66eb233a-c6b5-4781-9210-1a79bcabc977 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:26.746627 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-66eb233a-c6b5-4781-9210-1a79bcabc977 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.163031 Sep 09 13:17:26.747228 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 192/385] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:26 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:27.624623 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3c07cc51-9251-48a9-a671-5750d690e68f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:27.625255 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3c07cc51-9251-48a9-a671-5750d690e68f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:27.631749 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c07cc51-9251-48a9-a671-5750d690e68f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:27.632233 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c07cc51-9251-48a9-a671-5750d690e68f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:27.632671 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c07cc51-9251-48a9-a671-5750d690e68f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:27.633359 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c07cc51-9251-48a9-a671-5750d690e68f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:27.633818 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c07cc51-9251-48a9-a671-5750d690e68f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:27.634241 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c07cc51-9251-48a9-a671-5750d690e68f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:27.766853 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3c07cc51-9251-48a9-a671-5750d690e68f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:27.769558 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8ab1c73c-f970-4d97-913a-ffcfb5c755d0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:27.770167 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8ab1c73c-f970-4d97-913a-ffcfb5c755d0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:27.774578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3c07cc51-9251-48a9-a671-5750d690e68f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.154599 Sep 09 13:17:27.775159 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 194/386] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:27 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:27.776616 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab1c73c-f970-4d97-913a-ffcfb5c755d0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:27.777144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab1c73c-f970-4d97-913a-ffcfb5c755d0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:27.777589 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab1c73c-f970-4d97-913a-ffcfb5c755d0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:27.778282 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab1c73c-f970-4d97-913a-ffcfb5c755d0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:27.778737 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab1c73c-f970-4d97-913a-ffcfb5c755d0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:27.779184 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8ab1c73c-f970-4d97-913a-ffcfb5c755d0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:27.917238 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8ab1c73c-f970-4d97-913a-ffcfb5c755d0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:27.925722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8ab1c73c-f970-4d97-913a-ffcfb5c755d0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.160374 Sep 09 13:17:27.926298 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 193/387] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:27 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:28.798853 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c29aa9da-dad4-4af6-a255-49948cca0a60 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:28.800140 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c29aa9da-dad4-4af6-a255-49948cca0a60 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:28.807212 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c29aa9da-dad4-4af6-a255-49948cca0a60 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:28.807751 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c29aa9da-dad4-4af6-a255-49948cca0a60 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:28.808183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c29aa9da-dad4-4af6-a255-49948cca0a60 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:28.809613 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c29aa9da-dad4-4af6-a255-49948cca0a60 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:28.810067 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c29aa9da-dad4-4af6-a255-49948cca0a60 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:28.810492 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c29aa9da-dad4-4af6-a255-49948cca0a60 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:28.944871 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c29aa9da-dad4-4af6-a255-49948cca0a60 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:28.949108 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-03f4aa59-11c1-4563-8a55-f4d0a99271fe tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:28.949725 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-03f4aa59-11c1-4563-8a55-f4d0a99271fe tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:28.953987 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c29aa9da-dad4-4af6-a255-49948cca0a60 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.159787 Sep 09 13:17:28.954673 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 195/388] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:28 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:28.956794 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03f4aa59-11c1-4563-8a55-f4d0a99271fe tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:28.957300 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03f4aa59-11c1-4563-8a55-f4d0a99271fe tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:28.957760 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03f4aa59-11c1-4563-8a55-f4d0a99271fe tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:28.958435 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03f4aa59-11c1-4563-8a55-f4d0a99271fe tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:28.958895 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03f4aa59-11c1-4563-8a55-f4d0a99271fe tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:28.959368 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03f4aa59-11c1-4563-8a55-f4d0a99271fe tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:29.098087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-03f4aa59-11c1-4563-8a55-f4d0a99271fe tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:29.106276 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-03f4aa59-11c1-4563-8a55-f4d0a99271fe tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.161019 Sep 09 13:17:29.106838 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 194/389] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:28 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:29.977869 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-84a07762-0290-42cb-93fc-e5229f94aae9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:29.978568 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-84a07762-0290-42cb-93fc-e5229f94aae9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:29.985069 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a07762-0290-42cb-93fc-e5229f94aae9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:29.985549 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a07762-0290-42cb-93fc-e5229f94aae9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:29.985993 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a07762-0290-42cb-93fc-e5229f94aae9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:29.986683 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a07762-0290-42cb-93fc-e5229f94aae9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:29.987173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a07762-0290-42cb-93fc-e5229f94aae9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:29.987603 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a07762-0290-42cb-93fc-e5229f94aae9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:30.121113 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-84a07762-0290-42cb-93fc-e5229f94aae9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:30.128947 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-84a07762-0290-42cb-93fc-e5229f94aae9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.155175 Sep 09 13:17:30.129516 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 196/390] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:29 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:30.130905 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b56bf57b-3213-4374-a260-6bc48e992ddb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:30.131549 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b56bf57b-3213-4374-a260-6bc48e992ddb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:30.138638 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b56bf57b-3213-4374-a260-6bc48e992ddb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:30.139190 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b56bf57b-3213-4374-a260-6bc48e992ddb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:30.139629 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b56bf57b-3213-4374-a260-6bc48e992ddb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:30.140336 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b56bf57b-3213-4374-a260-6bc48e992ddb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:30.140791 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b56bf57b-3213-4374-a260-6bc48e992ddb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:30.141211 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b56bf57b-3213-4374-a260-6bc48e992ddb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:30.276098 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b56bf57b-3213-4374-a260-6bc48e992ddb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:30.284310 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b56bf57b-3213-4374-a260-6bc48e992ddb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.157277 Sep 09 13:17:30.284876 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 195/391] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:30 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:31.152296 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f02cbe11-8c03-46ca-b9ac-dba5e717b9e8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:31.153128 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f02cbe11-8c03-46ca-b9ac-dba5e717b9e8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:31.159481 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f02cbe11-8c03-46ca-b9ac-dba5e717b9e8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:31.159971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f02cbe11-8c03-46ca-b9ac-dba5e717b9e8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:31.160412 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f02cbe11-8c03-46ca-b9ac-dba5e717b9e8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:31.161115 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f02cbe11-8c03-46ca-b9ac-dba5e717b9e8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:31.161569 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f02cbe11-8c03-46ca-b9ac-dba5e717b9e8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:31.161997 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f02cbe11-8c03-46ca-b9ac-dba5e717b9e8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:31.290353 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f02cbe11-8c03-46ca-b9ac-dba5e717b9e8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:31.298602 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f02cbe11-8c03-46ca-b9ac-dba5e717b9e8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.150222 Sep 09 13:17:31.299202 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 197/392] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:31 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:31.306685 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b545d92b-ce13-4c29-80cc-faa690ac4e74 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:31.307313 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b545d92b-ce13-4c29-80cc-faa690ac4e74 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:31.314774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b545d92b-ce13-4c29-80cc-faa690ac4e74 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:31.315356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b545d92b-ce13-4c29-80cc-faa690ac4e74 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:31.315785 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b545d92b-ce13-4c29-80cc-faa690ac4e74 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:31.316746 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b545d92b-ce13-4c29-80cc-faa690ac4e74 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:31.317204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b545d92b-ce13-4c29-80cc-faa690ac4e74 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:31.317747 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b545d92b-ce13-4c29-80cc-faa690ac4e74 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:31.451625 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b545d92b-ce13-4c29-80cc-faa690ac4e74 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:31.459589 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b545d92b-ce13-4c29-80cc-faa690ac4e74 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.156626 Sep 09 13:17:31.460130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 196/393] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:31 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:32.321805 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-709dbd6b-fb68-46b3-b581-71546242722e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:32.322416 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-709dbd6b-fb68-46b3-b581-71546242722e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:32.329728 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-709dbd6b-fb68-46b3-b581-71546242722e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:32.330212 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-709dbd6b-fb68-46b3-b581-71546242722e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:32.330643 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-709dbd6b-fb68-46b3-b581-71546242722e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:32.331346 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-709dbd6b-fb68-46b3-b581-71546242722e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:32.331790 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-709dbd6b-fb68-46b3-b581-71546242722e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:32.332208 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-709dbd6b-fb68-46b3-b581-71546242722e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:32.462773 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-709dbd6b-fb68-46b3-b581-71546242722e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:32.470914 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-709dbd6b-fb68-46b3-b581-71546242722e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.153002 Sep 09 13:17:32.471505 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 198/394] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:32 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:32.482615 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba704105-3080-4536-b1f2-288a31eaa901 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:32.483345 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba704105-3080-4536-b1f2-288a31eaa901 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:32.489874 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba704105-3080-4536-b1f2-288a31eaa901 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:32.490368 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba704105-3080-4536-b1f2-288a31eaa901 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:32.490807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba704105-3080-4536-b1f2-288a31eaa901 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:32.491801 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba704105-3080-4536-b1f2-288a31eaa901 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:32.492259 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba704105-3080-4536-b1f2-288a31eaa901 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:32.492752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba704105-3080-4536-b1f2-288a31eaa901 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:32.634687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba704105-3080-4536-b1f2-288a31eaa901 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:32.643279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba704105-3080-4536-b1f2-288a31eaa901 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.164388 Sep 09 13:17:32.643859 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 197/395] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:32 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:33.493432 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-47b570d3-5189-4db4-8605-ef9be5c83b72 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:33.494455 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-47b570d3-5189-4db4-8605-ef9be5c83b72 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:33.503168 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47b570d3-5189-4db4-8605-ef9be5c83b72 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:33.503902 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47b570d3-5189-4db4-8605-ef9be5c83b72 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:33.504437 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47b570d3-5189-4db4-8605-ef9be5c83b72 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:33.505601 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47b570d3-5189-4db4-8605-ef9be5c83b72 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:33.505739 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47b570d3-5189-4db4-8605-ef9be5c83b72 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:33.506209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47b570d3-5189-4db4-8605-ef9be5c83b72 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:33.667197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5fa514b0-3420-4c1c-912b-50b8be386f56 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:33.669232 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5fa514b0-3420-4c1c-912b-50b8be386f56 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:33.679392 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fa514b0-3420-4c1c-912b-50b8be386f56 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:33.679876 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fa514b0-3420-4c1c-912b-50b8be386f56 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:33.686114 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fa514b0-3420-4c1c-912b-50b8be386f56 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:33.686896 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fa514b0-3420-4c1c-912b-50b8be386f56 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:33.687570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fa514b0-3420-4c1c-912b-50b8be386f56 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:33.688002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fa514b0-3420-4c1c-912b-50b8be386f56 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:33.714469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-47b570d3-5189-4db4-8605-ef9be5c83b72 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:33.723278 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-47b570d3-5189-4db4-8605-ef9be5c83b72 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.233852 Sep 09 13:17:33.727099 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 199/396] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:33 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:33.827787 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5fa514b0-3420-4c1c-912b-50b8be386f56 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:33.835446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5fa514b0-3420-4c1c-912b-50b8be386f56 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.173586 Sep 09 13:17:33.836013 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 198/397] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:33 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:34.748399 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2063faa5-2239-41b6-b178-c64d262b87cb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:34.749005 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2063faa5-2239-41b6-b178-c64d262b87cb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:34.751363 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:34.756393 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2063faa5-2239-41b6-b178-c64d262b87cb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:34.757094 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2063faa5-2239-41b6-b178-c64d262b87cb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:34.769870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2063faa5-2239-41b6-b178-c64d262b87cb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:34.769870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2063faa5-2239-41b6-b178-c64d262b87cb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:34.769870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2063faa5-2239-41b6-b178-c64d262b87cb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:34.769870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2063faa5-2239-41b6-b178-c64d262b87cb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:34.859586 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e5ae248-aff5-4130-964e-a7e7d9223277 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:34.860396 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3e5ae248-aff5-4130-964e-a7e7d9223277 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:34.867755 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5ae248-aff5-4130-964e-a7e7d9223277 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:34.868246 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5ae248-aff5-4130-964e-a7e7d9223277 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:34.868677 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5ae248-aff5-4130-964e-a7e7d9223277 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:34.869380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5ae248-aff5-4130-964e-a7e7d9223277 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:34.870010 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5ae248-aff5-4130-964e-a7e7d9223277 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:34.870654 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5ae248-aff5-4130-964e-a7e7d9223277 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:34.914804 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2063faa5-2239-41b6-b178-c64d262b87cb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:34.927674 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2063faa5-2239-41b6-b178-c64d262b87cb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.183376 Sep 09 13:17:34.928512 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 200/398] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:34 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:35.027159 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3e5ae248-aff5-4130-964e-a7e7d9223277 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:35.035498 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e5ae248-aff5-4130-964e-a7e7d9223277 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.181107 Sep 09 13:17:35.036169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 199/399] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:34 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:35.955222 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a3a11f66-1193-4bc2-b04b-f5f58ac197be tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:35.955836 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a3a11f66-1193-4bc2-b04b-f5f58ac197be tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:35.962700 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3a11f66-1193-4bc2-b04b-f5f58ac197be tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:35.963604 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3a11f66-1193-4bc2-b04b-f5f58ac197be tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:35.964039 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3a11f66-1193-4bc2-b04b-f5f58ac197be tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:35.964737 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3a11f66-1193-4bc2-b04b-f5f58ac197be tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:35.965822 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3a11f66-1193-4bc2-b04b-f5f58ac197be tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:35.966588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3a11f66-1193-4bc2-b04b-f5f58ac197be tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:36.061624 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4474f288-23af-492f-81cc-6516aae76847 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:36.062290 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4474f288-23af-492f-81cc-6516aae76847 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:36.069007 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4474f288-23af-492f-81cc-6516aae76847 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:36.069569 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4474f288-23af-492f-81cc-6516aae76847 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:36.070100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4474f288-23af-492f-81cc-6516aae76847 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:36.070887 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4474f288-23af-492f-81cc-6516aae76847 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:36.071362 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4474f288-23af-492f-81cc-6516aae76847 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:36.071781 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4474f288-23af-492f-81cc-6516aae76847 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:36.145922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a3a11f66-1193-4bc2-b04b-f5f58ac197be tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:36.155421 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a3a11f66-1193-4bc2-b04b-f5f58ac197be tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.203954 Sep 09 13:17:36.171584 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 201/400] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:35 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:36.213433 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4474f288-23af-492f-81cc-6516aae76847 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:36.222119 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4474f288-23af-492f-81cc-6516aae76847 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.165199 Sep 09 13:17:36.222895 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 200/401] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:36 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:37.179868 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-53eadeac-b280-40d0-8e69-06eb0bac2f37 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:37.180486 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-53eadeac-b280-40d0-8e69-06eb0bac2f37 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:37.187758 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-53eadeac-b280-40d0-8e69-06eb0bac2f37 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:37.188242 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-53eadeac-b280-40d0-8e69-06eb0bac2f37 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:37.188678 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-53eadeac-b280-40d0-8e69-06eb0bac2f37 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:37.189368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-53eadeac-b280-40d0-8e69-06eb0bac2f37 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:37.189819 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-53eadeac-b280-40d0-8e69-06eb0bac2f37 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:37.190241 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-53eadeac-b280-40d0-8e69-06eb0bac2f37 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:37.244916 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e39ba330-911c-4405-9a9a-125588fda8f1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:37.245524 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e39ba330-911c-4405-9a9a-125588fda8f1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:37.252814 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e39ba330-911c-4405-9a9a-125588fda8f1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:37.253291 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e39ba330-911c-4405-9a9a-125588fda8f1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:37.253718 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e39ba330-911c-4405-9a9a-125588fda8f1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:37.254405 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e39ba330-911c-4405-9a9a-125588fda8f1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:37.254857 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e39ba330-911c-4405-9a9a-125588fda8f1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:37.255294 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e39ba330-911c-4405-9a9a-125588fda8f1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:37.323857 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-53eadeac-b280-40d0-8e69-06eb0bac2f37 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:37.332355 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-53eadeac-b280-40d0-8e69-06eb0bac2f37 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.156230 Sep 09 13:17:37.332854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 202/402] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:37 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:37.385646 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e39ba330-911c-4405-9a9a-125588fda8f1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:37.394152 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e39ba330-911c-4405-9a9a-125588fda8f1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.153298 Sep 09 13:17:37.394710 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 201/403] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:37 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:38.354474 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-642c47b1-efab-4c7a-a3b0-50456f6c7f61 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:38.355673 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-642c47b1-efab-4c7a-a3b0-50456f6c7f61 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:38.362217 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-642c47b1-efab-4c7a-a3b0-50456f6c7f61 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:38.362627 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-642c47b1-efab-4c7a-a3b0-50456f6c7f61 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:38.362926 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b891bade-0f00-4d92-82a9-aa0e666c1c67 req-39efd9d5-4747-4606-bbde-850b5231e341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dfd749-af70-47be-a3de-523bc6cbd77d", "name": "network-vif-plugged", "status": "completed", "tag": "9f010fe5-2104-4a34-a352-227d3c7e2fca"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:17:38.363512 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-642c47b1-efab-4c7a-a3b0-50456f6c7f61 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:38.363765 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-642c47b1-efab-4c7a-a3b0-50456f6c7f61 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:38.364225 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-642c47b1-efab-4c7a-a3b0-50456f6c7f61 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:38.364655 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-642c47b1-efab-4c7a-a3b0-50456f6c7f61 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:38.375227 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b891bade-0f00-4d92-82a9-aa0e666c1c67 req-39efd9d5-4747-4606-bbde-850b5231e341 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:38.375710 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b891bade-0f00-4d92-82a9-aa0e666c1c67 req-39efd9d5-4747-4606-bbde-850b5231e341 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:38.376134 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b891bade-0f00-4d92-82a9-aa0e666c1c67 req-39efd9d5-4747-4606-bbde-850b5231e341 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:38.388428 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b891bade-0f00-4d92-82a9-aa0e666c1c67 req-39efd9d5-4747-4606-bbde-850b5231e341 service nova] Creating event network-vif-plugged:9f010fe5-2104-4a34-a352-227d3c7e2fca for instance 67dfd749-af70-47be-a3de-523bc6cbd77d on hv-cinder-83124 Sep 09 13:17:38.393728 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b891bade-0f00-4d92-82a9-aa0e666c1c67 req-39efd9d5-4747-4606-bbde-850b5231e341 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034794 Sep 09 13:17:38.394790 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 202/404] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:17:38.419430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea898187-1056-43ea-b5ef-713ef1ff578c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:38.420513 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ea898187-1056-43ea-b5ef-713ef1ff578c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:38.427043 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea898187-1056-43ea-b5ef-713ef1ff578c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:38.427759 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea898187-1056-43ea-b5ef-713ef1ff578c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:38.428421 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea898187-1056-43ea-b5ef-713ef1ff578c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:38.429329 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea898187-1056-43ea-b5ef-713ef1ff578c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:38.429966 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea898187-1056-43ea-b5ef-713ef1ff578c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:38.431413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea898187-1056-43ea-b5ef-713ef1ff578c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:38.512001 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-642c47b1-efab-4c7a-a3b0-50456f6c7f61 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:38.519882 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-642c47b1-efab-4c7a-a3b0-50456f6c7f61 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.169319 Sep 09 13:17:38.520460 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 203/405] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:38 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:38.597576 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ea898187-1056-43ea-b5ef-713ef1ff578c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:38.606281 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea898187-1056-43ea-b5ef-713ef1ff578c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.192145 Sep 09 13:17:38.612487 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 203/406] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:38 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:39.306549 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1927989530", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "networks": [{"uuid": "8e97ca6e-874b-4bc3-8a46-7260e60d3561"}]}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:17:39.361785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] validate_networks() for [('8e97ca6e-874b-4bc3-8a46-7260e60d3561', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:17:39.543630 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-80fa0315-b4a8-493a-854a-58b71473375b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:39.545320 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-80fa0315-b4a8-493a-854a-58b71473375b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:39.568369 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80fa0315-b4a8-493a-854a-58b71473375b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:39.568863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80fa0315-b4a8-493a-854a-58b71473375b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:39.569300 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80fa0315-b4a8-493a-854a-58b71473375b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:39.570002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80fa0315-b4a8-493a-854a-58b71473375b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:39.570458 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80fa0315-b4a8-493a-854a-58b71473375b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:39.570880 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-80fa0315-b4a8-493a-854a-58b71473375b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:39.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-80fa0315-b4a8-493a-854a-58b71473375b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:39.727959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-80fa0315-b4a8-493a-854a-58b71473375b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.188099 Sep 09 13:17:39.744707 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 204/407] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:39 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:39.751809 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-527f3734-cc18-48b5-ae46-ab1af40d43f0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:39.752734 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-527f3734-cc18-48b5-ae46-ab1af40d43f0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:39.759289 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-527f3734-cc18-48b5-ae46-ab1af40d43f0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:39.759892 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-527f3734-cc18-48b5-ae46-ab1af40d43f0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:39.760431 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-527f3734-cc18-48b5-ae46-ab1af40d43f0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:39.761346 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-527f3734-cc18-48b5-ae46-ab1af40d43f0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:39.762076 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-527f3734-cc18-48b5-ae46-ab1af40d43f0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:39.762539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-527f3734-cc18-48b5-ae46-ab1af40d43f0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:39.763419 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:17:39.763578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:17:39.764053 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:17:39.764463 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:17:39.764875 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:17:39.773698 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:39.774183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:39.774617 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:39.775414 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:39.775872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:39.776298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:39.800154 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Getting quotas for project 345a9eb6369c43a681649f1bb55ce60c. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:17:39.804275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Getting quotas for user 41ec6426ddf640389083cc61e948d31f and project 345a9eb6369c43a681649f1bb55ce60c. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:17:39.816320 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:17:39.818741 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:17:39.872576 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-dc10c557-ec77-4e06-95d6-c2f469add24b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569632 Sep 09 13:17:39.873369 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 204/408] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:17:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:17:39.884209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9a5c371f-2119-4ddd-8a5f-3f341ea238e6 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:39.884828 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9a5c371f-2119-4ddd-8a5f-3f341ea238e6 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:39.920146 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-527f3734-cc18-48b5-ae46-ab1af40d43f0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:39.929983 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-527f3734-cc18-48b5-ae46-ab1af40d43f0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1367 microversion: 2.1 time: 0.182236 Sep 09 13:17:39.930556 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 205/409] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:39 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:39.944696 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9a5c371f-2119-4ddd-8a5f-3f341ea238e6 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:39.951619 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9a5c371f-2119-4ddd-8a5f-3f341ea238e6 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1219 microversion: 2.1 time: 0.071303 Sep 09 13:17:39.952183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 205/410] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:39 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:40.752110 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78216046-57c6-4be0-8521-483b52a53909 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:40.752818 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-78216046-57c6-4be0-8521-483b52a53909 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:40.759247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78216046-57c6-4be0-8521-483b52a53909 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:40.759731 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78216046-57c6-4be0-8521-483b52a53909 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:40.760165 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78216046-57c6-4be0-8521-483b52a53909 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:40.760856 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78216046-57c6-4be0-8521-483b52a53909 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:40.761808 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78216046-57c6-4be0-8521-483b52a53909 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:40.762293 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-78216046-57c6-4be0-8521-483b52a53909 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:40.904526 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-78216046-57c6-4be0-8521-483b52a53909 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:40.916176 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-78216046-57c6-4be0-8521-483b52a53909 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.167466 Sep 09 13:17:40.916431 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 206/411] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:40 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:40.955356 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e038816e-f1fe-48a2-b67b-cbea4c938177 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:40.956568 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e038816e-f1fe-48a2-b67b-cbea4c938177 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:40.965078 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e038816e-f1fe-48a2-b67b-cbea4c938177 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:40.965895 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e038816e-f1fe-48a2-b67b-cbea4c938177 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:40.966581 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e038816e-f1fe-48a2-b67b-cbea4c938177 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:40.971186 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e038816e-f1fe-48a2-b67b-cbea4c938177 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:40.972243 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e038816e-f1fe-48a2-b67b-cbea4c938177 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:40.972831 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e038816e-f1fe-48a2-b67b-cbea4c938177 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:40.978831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a61b7d5a-13f6-4cef-8d98-dd576b03cd41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:40.979790 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a61b7d5a-13f6-4cef-8d98-dd576b03cd41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:40.987305 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a61b7d5a-13f6-4cef-8d98-dd576b03cd41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:40.987798 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a61b7d5a-13f6-4cef-8d98-dd576b03cd41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:40.988232 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a61b7d5a-13f6-4cef-8d98-dd576b03cd41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:40.988931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a61b7d5a-13f6-4cef-8d98-dd576b03cd41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:40.991023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a61b7d5a-13f6-4cef-8d98-dd576b03cd41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:40.991759 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a61b7d5a-13f6-4cef-8d98-dd576b03cd41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:41.070384 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a61b7d5a-13f6-4cef-8d98-dd576b03cd41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:41.081250 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a61b7d5a-13f6-4cef-8d98-dd576b03cd41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1271 microversion: 2.1 time: 0.109806 Sep 09 13:17:41.082139 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 207/412] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:40 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:41.145394 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e038816e-f1fe-48a2-b67b-cbea4c938177 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:41.154636 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e038816e-f1fe-48a2-b67b-cbea4c938177 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1558 microversion: 2.1 time: 0.203387 Sep 09 13:17:41.155300 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 206/413] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:40 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1558 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:41.177700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-98722b55-c764-464d-9819-cce7d401763e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:41.178189 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-98722b55-c764-464d-9819-cce7d401763e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:41.184459 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98722b55-c764-464d-9819-cce7d401763e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:41.184950 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98722b55-c764-464d-9819-cce7d401763e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:41.185440 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98722b55-c764-464d-9819-cce7d401763e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:41.186122 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98722b55-c764-464d-9819-cce7d401763e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:41.186632 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98722b55-c764-464d-9819-cce7d401763e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:41.187070 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98722b55-c764-464d-9819-cce7d401763e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:41.190792 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:41.270948 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-98722b55-c764-464d-9819-cce7d401763e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097130 Sep 09 13:17:41.271577 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 208/414] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 13:17:41 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:17:41.941283 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-aa720b9b-0fc3-4efc-bb66-5e24a5d4886b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:41.942694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-aa720b9b-0fc3-4efc-bb66-5e24a5d4886b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:41.952040 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa720b9b-0fc3-4efc-bb66-5e24a5d4886b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:41.952953 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa720b9b-0fc3-4efc-bb66-5e24a5d4886b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:41.953734 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa720b9b-0fc3-4efc-bb66-5e24a5d4886b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:41.954676 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa720b9b-0fc3-4efc-bb66-5e24a5d4886b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:41.955186 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa720b9b-0fc3-4efc-bb66-5e24a5d4886b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:41.955614 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa720b9b-0fc3-4efc-bb66-5e24a5d4886b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:42.106662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-75ee5a66-0d47-4c73-8a0b-9f42d2434be4 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:42.107316 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-75ee5a66-0d47-4c73-8a0b-9f42d2434be4 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:42.114434 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75ee5a66-0d47-4c73-8a0b-9f42d2434be4 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:42.115189 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75ee5a66-0d47-4c73-8a0b-9f42d2434be4 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:42.115777 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75ee5a66-0d47-4c73-8a0b-9f42d2434be4 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:42.116910 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75ee5a66-0d47-4c73-8a0b-9f42d2434be4 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:42.117529 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75ee5a66-0d47-4c73-8a0b-9f42d2434be4 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:42.118151 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-75ee5a66-0d47-4c73-8a0b-9f42d2434be4 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:42.239832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-aa720b9b-0fc3-4efc-bb66-5e24a5d4886b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:42.247518 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-aa720b9b-0fc3-4efc-bb66-5e24a5d4886b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.310611 Sep 09 13:17:42.251833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 207/415] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:41 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:42.526818 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-b5158f44-bd4b-421d-8157-3d6306f24923 req-b76dee31-bea1-45f5-8ee7-eb10bc71910e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8d3e22-93f3-4251-bbfc-8bd5c60cb875", "name": "network-vif-plugged", "status": "completed", "tag": "b82ef3ba-9f78-4e05-830b-166b5fa60d7f"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:17:42.548046 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-b5158f44-bd4b-421d-8157-3d6306f24923 req-b76dee31-bea1-45f5-8ee7-eb10bc71910e service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:42.549397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-b5158f44-bd4b-421d-8157-3d6306f24923 req-b76dee31-bea1-45f5-8ee7-eb10bc71910e service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:42.551554 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-b5158f44-bd4b-421d-8157-3d6306f24923 req-b76dee31-bea1-45f5-8ee7-eb10bc71910e service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:42.566352 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-75ee5a66-0d47-4c73-8a0b-9f42d2434be4 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:42.579331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-75ee5a66-0d47-4c73-8a0b-9f42d2434be4 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.477235 Sep 09 13:17:42.580090 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 209/416] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:42 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:42.586759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:42.589167 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-b5158f44-bd4b-421d-8157-3d6306f24923 req-b76dee31-bea1-45f5-8ee7-eb10bc71910e service nova] Creating event network-vif-plugged:b82ef3ba-9f78-4e05-830b-166b5fa60d7f for instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 on hv-cinder-83124 Sep 09 13:17:42.599696 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-b5158f44-bd4b-421d-8157-3d6306f24923 req-b76dee31-bea1-45f5-8ee7-eb10bc71910e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075911 Sep 09 13:17:42.601202 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 208/417] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:17:42.865658 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-afe8b9d5-5662-45b2-80d2-4c73100c3160 req-5930f17a-59f3-4b33-9c1e-54b17aa612c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67dfd749-af70-47be-a3de-523bc6cbd77d", "tag": "9f010fe5-2104-4a34-a352-227d3c7e2fca"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:17:42.906678 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-afe8b9d5-5662-45b2-80d2-4c73100c3160 req-5930f17a-59f3-4b33-9c1e-54b17aa612c2 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:42.907458 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-afe8b9d5-5662-45b2-80d2-4c73100c3160 req-5930f17a-59f3-4b33-9c1e-54b17aa612c2 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:42.908603 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-afe8b9d5-5662-45b2-80d2-4c73100c3160 req-5930f17a-59f3-4b33-9c1e-54b17aa612c2 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:42.950490 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-afe8b9d5-5662-45b2-80d2-4c73100c3160 req-5930f17a-59f3-4b33-9c1e-54b17aa612c2 service nova] Creating event network-changed:9f010fe5-2104-4a34-a352-227d3c7e2fca for instance 67dfd749-af70-47be-a3de-523bc6cbd77d on hv-cinder-83124 Sep 09 13:17:42.962215 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-afe8b9d5-5662-45b2-80d2-4c73100c3160 req-5930f17a-59f3-4b33-9c1e-54b17aa612c2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104152 Sep 09 13:17:42.969014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 210/418] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:17:43.280460 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d57f8d0e-7c18-4c17-b528-d31fd18d2da5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:43.282235 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d57f8d0e-7c18-4c17-b528-d31fd18d2da5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:43.293642 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d57f8d0e-7c18-4c17-b528-d31fd18d2da5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:43.295154 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d57f8d0e-7c18-4c17-b528-d31fd18d2da5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:43.295913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d57f8d0e-7c18-4c17-b528-d31fd18d2da5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:43.297563 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d57f8d0e-7c18-4c17-b528-d31fd18d2da5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:43.298257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d57f8d0e-7c18-4c17-b528-d31fd18d2da5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:43.299277 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d57f8d0e-7c18-4c17-b528-d31fd18d2da5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:43.546035 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d57f8d0e-7c18-4c17-b528-d31fd18d2da5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:43.562943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d57f8d0e-7c18-4c17-b528-d31fd18d2da5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.290062 Sep 09 13:17:43.563528 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 209/419] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:43 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:17:43.606922 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d6530673-1270-4a46-b353-b92099068208 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:43.609310 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d6530673-1270-4a46-b353-b92099068208 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:43.616942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=68 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:43.619194 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6530673-1270-4a46-b353-b92099068208 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:43.619816 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6530673-1270-4a46-b353-b92099068208 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:43.621514 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6530673-1270-4a46-b353-b92099068208 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:43.622265 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6530673-1270-4a46-b353-b92099068208 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:43.622797 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6530673-1270-4a46-b353-b92099068208 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:43.623220 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d6530673-1270-4a46-b353-b92099068208 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:43.767669 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-5391c248-692f-4199-8c6b-60fa72da9bee req-3b0bfcb7-8976-4522-8375-4e6c66af3130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6949716a-80fb-47e7-84fc-4c4f5b656436", "tag": "b5cc5bef-ccd1-4987-9ede-7c59c7746d20"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:17:43.782601 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-5391c248-692f-4199-8c6b-60fa72da9bee req-3b0bfcb7-8976-4522-8375-4e6c66af3130 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:43.783482 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-5391c248-692f-4199-8c6b-60fa72da9bee req-3b0bfcb7-8976-4522-8375-4e6c66af3130 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:43.784094 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-5391c248-692f-4199-8c6b-60fa72da9bee req-3b0bfcb7-8976-4522-8375-4e6c66af3130 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:43.798908 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d6530673-1270-4a46-b353-b92099068208 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:43.799379 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-5391c248-692f-4199-8c6b-60fa72da9bee req-3b0bfcb7-8976-4522-8375-4e6c66af3130 service nova] Creating event network-changed:b5cc5bef-ccd1-4987-9ede-7c59c7746d20 for instance 6949716a-80fb-47e7-84fc-4c4f5b656436 on hv-cinder-83124 Sep 09 13:17:43.804983 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-5391c248-692f-4199-8c6b-60fa72da9bee req-3b0bfcb7-8976-4522-8375-4e6c66af3130 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042293 Sep 09 13:17:43.806118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 210/420] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:17:43.809727 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d6530673-1270-4a46-b353-b92099068208 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.210128 Sep 09 13:17:43.810607 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 211/421] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:43 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:44.588820 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-78324098-6db4-41be-a5a3-138972593742 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:44.589460 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-78324098-6db4-41be-a5a3-138972593742 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:44.595951 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-78324098-6db4-41be-a5a3-138972593742 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:44.596517 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-78324098-6db4-41be-a5a3-138972593742 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:44.600526 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-78324098-6db4-41be-a5a3-138972593742 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:44.601267 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-78324098-6db4-41be-a5a3-138972593742 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:44.604587 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-78324098-6db4-41be-a5a3-138972593742 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:44.604587 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-78324098-6db4-41be-a5a3-138972593742 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:44.734336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-78324098-6db4-41be-a5a3-138972593742 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:44.742207 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-78324098-6db4-41be-a5a3-138972593742 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.158254 Sep 09 13:17:44.742772 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 211/422] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:44 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:44.832425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-822fd964-31cc-433b-a235-cf9bb2c8f7e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:44.833041 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-822fd964-31cc-433b-a235-cf9bb2c8f7e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:44.839477 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-822fd964-31cc-433b-a235-cf9bb2c8f7e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:44.839901 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-822fd964-31cc-433b-a235-cf9bb2c8f7e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:44.840336 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-822fd964-31cc-433b-a235-cf9bb2c8f7e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:44.841025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-822fd964-31cc-433b-a235-cf9bb2c8f7e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:44.841479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-822fd964-31cc-433b-a235-cf9bb2c8f7e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:44.841929 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-822fd964-31cc-433b-a235-cf9bb2c8f7e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:44.976552 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-822fd964-31cc-433b-a235-cf9bb2c8f7e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:44.984577 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-822fd964-31cc-433b-a235-cf9bb2c8f7e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.156274 Sep 09 13:17:44.985149 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 212/423] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:44 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:45.766531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e148c7c7-9c27-4839-b73b-11822f786a0f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:45.767167 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e148c7c7-9c27-4839-b73b-11822f786a0f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:45.773695 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e148c7c7-9c27-4839-b73b-11822f786a0f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:45.774211 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e148c7c7-9c27-4839-b73b-11822f786a0f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:45.774650 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e148c7c7-9c27-4839-b73b-11822f786a0f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:45.775407 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e148c7c7-9c27-4839-b73b-11822f786a0f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:45.775859 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e148c7c7-9c27-4839-b73b-11822f786a0f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:45.776319 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e148c7c7-9c27-4839-b73b-11822f786a0f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:45.907034 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e148c7c7-9c27-4839-b73b-11822f786a0f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:45.914608 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e148c7c7-9c27-4839-b73b-11822f786a0f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.152848 Sep 09 13:17:45.915183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 212/424] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:45 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:46.007711 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-57bafd48-e38d-4940-b781-ac471a3d5690 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:46.008312 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-57bafd48-e38d-4940-b781-ac471a3d5690 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:46.015658 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57bafd48-e38d-4940-b781-ac471a3d5690 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:46.016676 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57bafd48-e38d-4940-b781-ac471a3d5690 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:46.016844 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57bafd48-e38d-4940-b781-ac471a3d5690 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:46.017717 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57bafd48-e38d-4940-b781-ac471a3d5690 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:46.018362 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57bafd48-e38d-4940-b781-ac471a3d5690 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:46.018956 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-57bafd48-e38d-4940-b781-ac471a3d5690 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:46.159993 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-57bafd48-e38d-4940-b781-ac471a3d5690 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:46.167570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-57bafd48-e38d-4940-b781-ac471a3d5690 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.163522 Sep 09 13:17:46.168673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 213/425] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:46 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:46.937350 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6324ce47-20f5-446f-9c04-d21478926ba4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:46.937960 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6324ce47-20f5-446f-9c04-d21478926ba4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:46.944491 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6324ce47-20f5-446f-9c04-d21478926ba4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:46.944963 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6324ce47-20f5-446f-9c04-d21478926ba4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:46.945392 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6324ce47-20f5-446f-9c04-d21478926ba4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:46.946068 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6324ce47-20f5-446f-9c04-d21478926ba4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:46.946516 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6324ce47-20f5-446f-9c04-d21478926ba4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:46.946935 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6324ce47-20f5-446f-9c04-d21478926ba4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:47.081893 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6324ce47-20f5-446f-9c04-d21478926ba4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:47.090622 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6324ce47-20f5-446f-9c04-d21478926ba4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1369 microversion: 2.1 time: 0.157705 Sep 09 13:17:47.091228 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 213/426] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:46 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:47.190366 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-542d45b0-8eb6-4bfd-bf7a-c468ae99458b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:47.190909 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-542d45b0-8eb6-4bfd-bf7a-c468ae99458b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:47.196940 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542d45b0-8eb6-4bfd-bf7a-c468ae99458b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:47.197418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542d45b0-8eb6-4bfd-bf7a-c468ae99458b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:47.197850 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542d45b0-8eb6-4bfd-bf7a-c468ae99458b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:47.198531 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542d45b0-8eb6-4bfd-bf7a-c468ae99458b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:47.199581 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542d45b0-8eb6-4bfd-bf7a-c468ae99458b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:47.200002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-542d45b0-8eb6-4bfd-bf7a-c468ae99458b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:47.331445 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-542d45b0-8eb6-4bfd-bf7a-c468ae99458b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:47.339060 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-542d45b0-8eb6-4bfd-bf7a-c468ae99458b tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.152555 Sep 09 13:17:47.340200 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 214/427] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:47 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:48.114110 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-de94f49e-e03b-482e-8118-88a6bf3dc2d4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:48.114958 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-de94f49e-e03b-482e-8118-88a6bf3dc2d4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:48.122756 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de94f49e-e03b-482e-8118-88a6bf3dc2d4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:48.123275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de94f49e-e03b-482e-8118-88a6bf3dc2d4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:48.123713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de94f49e-e03b-482e-8118-88a6bf3dc2d4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:48.124565 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de94f49e-e03b-482e-8118-88a6bf3dc2d4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:48.125261 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de94f49e-e03b-482e-8118-88a6bf3dc2d4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:48.125694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-de94f49e-e03b-482e-8118-88a6bf3dc2d4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:48.270803 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-de94f49e-e03b-482e-8118-88a6bf3dc2d4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:48.279507 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-de94f49e-e03b-482e-8118-88a6bf3dc2d4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1562 microversion: 2.1 time: 0.169411 Sep 09 13:17:48.280081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 214/428] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:48 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:48.304859 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38a128d4-e954-4f75-88e6-493dab67d3cf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:48.305524 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-38a128d4-e954-4f75-88e6-493dab67d3cf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:48.312677 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a128d4-e954-4f75-88e6-493dab67d3cf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:48.313168 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a128d4-e954-4f75-88e6-493dab67d3cf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:48.313607 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a128d4-e954-4f75-88e6-493dab67d3cf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:48.314480 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a128d4-e954-4f75-88e6-493dab67d3cf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:48.314939 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a128d4-e954-4f75-88e6-493dab67d3cf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:48.315391 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38a128d4-e954-4f75-88e6-493dab67d3cf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:48.362485 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9a173804-329e-4cba-855b-c318a910f665 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:48.363535 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9a173804-329e-4cba-855b-c318a910f665 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:48.370003 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a173804-329e-4cba-855b-c318a910f665 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:48.370499 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a173804-329e-4cba-855b-c318a910f665 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:48.370964 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a173804-329e-4cba-855b-c318a910f665 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:48.371881 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a173804-329e-4cba-855b-c318a910f665 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:48.372326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a173804-329e-4cba-855b-c318a910f665 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:48.372759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a173804-329e-4cba-855b-c318a910f665 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:48.416698 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-38a128d4-e954-4f75-88e6-493dab67d3cf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115704 Sep 09 13:17:48.417308 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 215/429] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 13:17:48 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:17:48.645804 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9a173804-329e-4cba-855b-c318a910f665 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:48.655279 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9a173804-329e-4cba-855b-c318a910f665 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.296390 Sep 09 13:17:48.656123 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 215/430] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:48 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:49.684297 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-048eadf9-9f8c-42f6-8fbb-5ffad83af337 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:49.686543 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-048eadf9-9f8c-42f6-8fbb-5ffad83af337 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:49.697219 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048eadf9-9f8c-42f6-8fbb-5ffad83af337 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:49.698354 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048eadf9-9f8c-42f6-8fbb-5ffad83af337 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:49.700139 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048eadf9-9f8c-42f6-8fbb-5ffad83af337 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:49.701497 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048eadf9-9f8c-42f6-8fbb-5ffad83af337 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:49.702131 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048eadf9-9f8c-42f6-8fbb-5ffad83af337 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:49.702625 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-048eadf9-9f8c-42f6-8fbb-5ffad83af337 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:49.836274 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-6d20eb9b-5376-48ef-b823-d557737e0ef8 req-b67ecf61-c8fd-4a1e-906e-4110749d981c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8d3e22-93f3-4251-bbfc-8bd5c60cb875", "tag": "b82ef3ba-9f78-4e05-830b-166b5fa60d7f"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:17:49.845967 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:49.849443 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6d20eb9b-5376-48ef-b823-d557737e0ef8 req-b67ecf61-c8fd-4a1e-906e-4110749d981c service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:49.850354 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6d20eb9b-5376-48ef-b823-d557737e0ef8 req-b67ecf61-c8fd-4a1e-906e-4110749d981c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:49.851327 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6d20eb9b-5376-48ef-b823-d557737e0ef8 req-b67ecf61-c8fd-4a1e-906e-4110749d981c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:49.871703 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-6d20eb9b-5376-48ef-b823-d557737e0ef8 req-b67ecf61-c8fd-4a1e-906e-4110749d981c service nova] Creating event network-changed:b82ef3ba-9f78-4e05-830b-166b5fa60d7f for instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 on hv-cinder-83124 Sep 09 13:17:49.881649 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-6d20eb9b-5376-48ef-b823-d557737e0ef8 req-b67ecf61-c8fd-4a1e-906e-4110749d981c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050760 Sep 09 13:17:49.882950 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 216/431] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:17:49.891129 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-048eadf9-9f8c-42f6-8fbb-5ffad83af337 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:49.900535 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-048eadf9-9f8c-42f6-8fbb-5ffad83af337 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.223494 Sep 09 13:17:49.901330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 216/432] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:49 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:50.922229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=8 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:17:50.927136 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3fe10a9a-f638-459f-bbb4-1b0a3b2a1949 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:50.927882 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3fe10a9a-f638-459f-bbb4-1b0a3b2a1949 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:50.935542 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fe10a9a-f638-459f-bbb4-1b0a3b2a1949 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:50.936388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fe10a9a-f638-459f-bbb4-1b0a3b2a1949 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:50.936894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fe10a9a-f638-459f-bbb4-1b0a3b2a1949 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:50.937706 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fe10a9a-f638-459f-bbb4-1b0a3b2a1949 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:50.938048 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fe10a9a-f638-459f-bbb4-1b0a3b2a1949 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:50.938479 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fe10a9a-f638-459f-bbb4-1b0a3b2a1949 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:51.069539 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3fe10a9a-f638-459f-bbb4-1b0a3b2a1949 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:51.077336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3fe10a9a-f638-459f-bbb4-1b0a3b2a1949 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.156058 Sep 09 13:17:51.077897 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 217/433] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:50 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:52.101082 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-994691a7-e04f-4a99-a916-7e6323c5c7c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:52.101622 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-994691a7-e04f-4a99-a916-7e6323c5c7c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:52.108887 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-994691a7-e04f-4a99-a916-7e6323c5c7c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:52.109364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-994691a7-e04f-4a99-a916-7e6323c5c7c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:52.109797 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-994691a7-e04f-4a99-a916-7e6323c5c7c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:52.110480 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-994691a7-e04f-4a99-a916-7e6323c5c7c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:52.110927 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-994691a7-e04f-4a99-a916-7e6323c5c7c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:52.111370 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-994691a7-e04f-4a99-a916-7e6323c5c7c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:52.244533 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-994691a7-e04f-4a99-a916-7e6323c5c7c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:52.252226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-994691a7-e04f-4a99-a916-7e6323c5c7c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.155018 Sep 09 13:17:52.252795 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 217/434] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:52 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:53.275286 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c5e9c595-8c95-49bb-b613-0614a6facba2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:53.275990 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c5e9c595-8c95-49bb-b613-0614a6facba2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:53.283253 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c5e9c595-8c95-49bb-b613-0614a6facba2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:53.283740 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c5e9c595-8c95-49bb-b613-0614a6facba2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:53.284174 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c5e9c595-8c95-49bb-b613-0614a6facba2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:53.284867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c5e9c595-8c95-49bb-b613-0614a6facba2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:53.285318 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c5e9c595-8c95-49bb-b613-0614a6facba2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:53.285740 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c5e9c595-8c95-49bb-b613-0614a6facba2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:53.416615 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c5e9c595-8c95-49bb-b613-0614a6facba2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:53.424223 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c5e9c595-8c95-49bb-b613-0614a6facba2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.152821 Sep 09 13:17:53.425072 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 218/435] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:53 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:54.446804 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d46ddd8f-fc84-4a84-988c-78f1f5d33ede tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:54.447442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d46ddd8f-fc84-4a84-988c-78f1f5d33ede tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:54.453971 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d46ddd8f-fc84-4a84-988c-78f1f5d33ede tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:54.454450 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d46ddd8f-fc84-4a84-988c-78f1f5d33ede tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:54.454879 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d46ddd8f-fc84-4a84-988c-78f1f5d33ede tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:54.455590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d46ddd8f-fc84-4a84-988c-78f1f5d33ede tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:54.456038 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d46ddd8f-fc84-4a84-988c-78f1f5d33ede tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:54.456455 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d46ddd8f-fc84-4a84-988c-78f1f5d33ede tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:54.585008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d46ddd8f-fc84-4a84-988c-78f1f5d33ede tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:54.593170 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d46ddd8f-fc84-4a84-988c-78f1f5d33ede tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.150183 Sep 09 13:17:54.593739 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 218/436] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:54 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:55.616475 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-209d1d5b-d0b8-46e2-ba33-9da31dbcaf2c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:55.617345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-209d1d5b-d0b8-46e2-ba33-9da31dbcaf2c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:55.625547 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-209d1d5b-d0b8-46e2-ba33-9da31dbcaf2c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:55.626024 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-209d1d5b-d0b8-46e2-ba33-9da31dbcaf2c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:55.626456 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-209d1d5b-d0b8-46e2-ba33-9da31dbcaf2c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:55.627173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-209d1d5b-d0b8-46e2-ba33-9da31dbcaf2c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:55.627657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-209d1d5b-d0b8-46e2-ba33-9da31dbcaf2c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:55.628157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-209d1d5b-d0b8-46e2-ba33-9da31dbcaf2c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:55.763257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-209d1d5b-d0b8-46e2-ba33-9da31dbcaf2c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:55.770779 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-209d1d5b-d0b8-46e2-ba33-9da31dbcaf2c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.158219 Sep 09 13:17:55.771388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 219/437] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:55 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:56.793939 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ca900b7-cb36-49bb-a32a-932705e0083a tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:56.794562 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ca900b7-cb36-49bb-a32a-932705e0083a tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:56.801207 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ca900b7-cb36-49bb-a32a-932705e0083a tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:56.801690 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ca900b7-cb36-49bb-a32a-932705e0083a tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:56.802123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ca900b7-cb36-49bb-a32a-932705e0083a tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:56.802867 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ca900b7-cb36-49bb-a32a-932705e0083a tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:56.803349 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ca900b7-cb36-49bb-a32a-932705e0083a tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:56.803770 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ca900b7-cb36-49bb-a32a-932705e0083a tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:56.940334 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2ca900b7-cb36-49bb-a32a-932705e0083a tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:56.947958 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ca900b7-cb36-49bb-a32a-932705e0083a tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.157916 Sep 09 13:17:56.948527 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 219/438] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:56 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:57.971535 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b5ffc77b-cf35-4584-8a4c-3e1dad5505d9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:57.972129 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b5ffc77b-cf35-4584-8a4c-3e1dad5505d9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:57.978597 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5ffc77b-cf35-4584-8a4c-3e1dad5505d9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:57.979120 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5ffc77b-cf35-4584-8a4c-3e1dad5505d9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:57.979559 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5ffc77b-cf35-4584-8a4c-3e1dad5505d9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:57.980285 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5ffc77b-cf35-4584-8a4c-3e1dad5505d9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:57.980744 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5ffc77b-cf35-4584-8a4c-3e1dad5505d9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:57.981165 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5ffc77b-cf35-4584-8a4c-3e1dad5505d9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:58.111247 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b5ffc77b-cf35-4584-8a4c-3e1dad5505d9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:58.119760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b5ffc77b-cf35-4584-8a4c-3e1dad5505d9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.152033 Sep 09 13:17:58.120343 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 220/439] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:57 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:17:59.143442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9a032d2-a3c0-4e6d-a4aa-dc355f8501e2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:17:59.144030 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a9a032d2-a3c0-4e6d-a4aa-dc355f8501e2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:17:59.150483 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9a032d2-a3c0-4e6d-a4aa-dc355f8501e2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:59.150963 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9a032d2-a3c0-4e6d-a4aa-dc355f8501e2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:59.151430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9a032d2-a3c0-4e6d-a4aa-dc355f8501e2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:59.152379 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9a032d2-a3c0-4e6d-a4aa-dc355f8501e2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:17:59.152845 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9a032d2-a3c0-4e6d-a4aa-dc355f8501e2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:17:59.153269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9a032d2-a3c0-4e6d-a4aa-dc355f8501e2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:17:59.282641 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a9a032d2-a3c0-4e6d-a4aa-dc355f8501e2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:17:59.290625 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a9a032d2-a3c0-4e6d-a4aa-dc355f8501e2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.151006 Sep 09 13:17:59.291198 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 220/440] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:17:59 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:00.317154 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-daa9ec1b-4f4f-4146-8f16-88d68484c53f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:00.317777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-daa9ec1b-4f4f-4146-8f16-88d68484c53f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:00.329722 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-daa9ec1b-4f4f-4146-8f16-88d68484c53f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:00.330353 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-daa9ec1b-4f4f-4146-8f16-88d68484c53f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:00.331128 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-daa9ec1b-4f4f-4146-8f16-88d68484c53f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:00.332063 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-daa9ec1b-4f4f-4146-8f16-88d68484c53f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:00.332729 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-daa9ec1b-4f4f-4146-8f16-88d68484c53f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:00.333213 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-daa9ec1b-4f4f-4146-8f16-88d68484c53f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:00.402852 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-81c03d45-09c7-4f03-8cbb-58ee8a8d7f5e req-74ef876c-830a-4a5e-be09-32d5f7cc6717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6949716a-80fb-47e7-84fc-4c4f5b656436", "name": "network-vif-plugged", "status": "completed", "tag": "b5cc5bef-ccd1-4987-9ede-7c59c7746d20"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:00.424980 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-81c03d45-09c7-4f03-8cbb-58ee8a8d7f5e req-74ef876c-830a-4a5e-be09-32d5f7cc6717 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:00.425905 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-81c03d45-09c7-4f03-8cbb-58ee8a8d7f5e req-74ef876c-830a-4a5e-be09-32d5f7cc6717 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:00.426898 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-81c03d45-09c7-4f03-8cbb-58ee8a8d7f5e req-74ef876c-830a-4a5e-be09-32d5f7cc6717 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:00.444616 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-81c03d45-09c7-4f03-8cbb-58ee8a8d7f5e req-74ef876c-830a-4a5e-be09-32d5f7cc6717 service nova] Creating event network-vif-plugged:b5cc5bef-ccd1-4987-9ede-7c59c7746d20 for instance 6949716a-80fb-47e7-84fc-4c4f5b656436 on hv-cinder-83124 Sep 09 13:18:00.450908 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-81c03d45-09c7-4f03-8cbb-58ee8a8d7f5e req-74ef876c-830a-4a5e-be09-32d5f7cc6717 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060051 Sep 09 13:18:00.451946 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 221/441] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:00.511425 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-daa9ec1b-4f4f-4146-8f16-88d68484c53f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:00.521832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-daa9ec1b-4f4f-4146-8f16-88d68484c53f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.211289 Sep 09 13:18:00.522662 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 221/442] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:00 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:01.546973 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-42491254-5ced-4cba-8238-2aaa09a96bd9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:01.547737 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-42491254-5ced-4cba-8238-2aaa09a96bd9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:01.553802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42491254-5ced-4cba-8238-2aaa09a96bd9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:01.554356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42491254-5ced-4cba-8238-2aaa09a96bd9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:01.554856 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42491254-5ced-4cba-8238-2aaa09a96bd9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:01.555575 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42491254-5ced-4cba-8238-2aaa09a96bd9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:01.556015 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42491254-5ced-4cba-8238-2aaa09a96bd9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:01.556652 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-42491254-5ced-4cba-8238-2aaa09a96bd9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:01.705015 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-42491254-5ced-4cba-8238-2aaa09a96bd9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:01.712810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-42491254-5ced-4cba-8238-2aaa09a96bd9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.171256 Sep 09 13:18:01.713468 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 222/443] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:01 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:02.735938 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f9351e3b-e704-4686-94ca-c209a373a954 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:02.736559 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f9351e3b-e704-4686-94ca-c209a373a954 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:02.745072 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f9351e3b-e704-4686-94ca-c209a373a954 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:02.746929 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f9351e3b-e704-4686-94ca-c209a373a954 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:02.747949 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f9351e3b-e704-4686-94ca-c209a373a954 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:02.749596 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f9351e3b-e704-4686-94ca-c209a373a954 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:02.750610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f9351e3b-e704-4686-94ca-c209a373a954 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:02.751592 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f9351e3b-e704-4686-94ca-c209a373a954 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:02.994609 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f9351e3b-e704-4686-94ca-c209a373a954 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:03.029973 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f9351e3b-e704-4686-94ca-c209a373a954 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1319 microversion: 2.1 time: 0.297688 Sep 09 13:18:03.031257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 222/444] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:02 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:04.054368 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c7e3d115-b38d-406a-ad14-66ae5d72c1c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:04.055685 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c7e3d115-b38d-406a-ad14-66ae5d72c1c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:04.063341 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7e3d115-b38d-406a-ad14-66ae5d72c1c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:04.064109 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7e3d115-b38d-406a-ad14-66ae5d72c1c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:04.065226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7e3d115-b38d-406a-ad14-66ae5d72c1c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:04.066100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7e3d115-b38d-406a-ad14-66ae5d72c1c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:04.066976 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7e3d115-b38d-406a-ad14-66ae5d72c1c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:04.067616 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7e3d115-b38d-406a-ad14-66ae5d72c1c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:04.251905 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c7e3d115-b38d-406a-ad14-66ae5d72c1c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:04.260789 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c7e3d115-b38d-406a-ad14-66ae5d72c1c5 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1507 microversion: 2.1 time: 0.210873 Sep 09 13:18:04.262569 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 223/445] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:04 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:15.113971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a354f472-25a6-4790-a001-0c3fd143e443 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:15.114823 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a354f472-25a6-4790-a001-0c3fd143e443 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:15.134169 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:15.135450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=77 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:15.139848 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a354f472-25a6-4790-a001-0c3fd143e443 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:15.141081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a354f472-25a6-4790-a001-0c3fd143e443 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:15.142418 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a354f472-25a6-4790-a001-0c3fd143e443 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:15.144581 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a354f472-25a6-4790-a001-0c3fd143e443 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:15.147348 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a354f472-25a6-4790-a001-0c3fd143e443 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:15.148345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a354f472-25a6-4790-a001-0c3fd143e443 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:15.231618 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a354f472-25a6-4790-a001-0c3fd143e443 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/ips" status: 200 len: 152 microversion: 2.20 time: 0.120608 Sep 09 13:18:15.241142 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 223/446] 10.222.0.17 () {60 vars in 1289 bytes} [Fri Sep 9 13:18:15 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/ips => generated 152 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:18:17.661266 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e01b0c02-4ac7-4aaf-a728-9ce08de3de11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:17.662604 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e01b0c02-4ac7-4aaf-a728-9ce08de3de11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:17.673376 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=25 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:17.674769 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=82 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:17.678688 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e01b0c02-4ac7-4aaf-a728-9ce08de3de11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:17.687992 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e01b0c02-4ac7-4aaf-a728-9ce08de3de11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:17.689184 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e01b0c02-4ac7-4aaf-a728-9ce08de3de11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:17.690698 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e01b0c02-4ac7-4aaf-a728-9ce08de3de11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:17.691588 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e01b0c02-4ac7-4aaf-a728-9ce08de3de11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:17.692320 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e01b0c02-4ac7-4aaf-a728-9ce08de3de11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:17.764322 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-e01b0c02-4ac7-4aaf-a728-9ce08de3de11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lazy-loading 'flavor' on Instance uuid 9f961e5a-6c12-48b6-ae52-e61b993275b3 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:18:18.391082 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e01b0c02-4ac7-4aaf-a728-9ce08de3de11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "POST /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/action" status: 202 len: 0 microversion: 2.20 time: 0.732157 Sep 09 13:18:18.393358 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 224/447] 10.222.0.17 () {62 vars in 1319 bytes} [Fri Sep 9 13:18:17 2022] POST /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/action => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:18:18.409425 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1e428c56-ba55-4c8e-9770-67f0a091813c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:18.410677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1e428c56-ba55-4c8e-9770-67f0a091813c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:18.433726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e428c56-ba55-4c8e-9770-67f0a091813c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:18.434637 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e428c56-ba55-4c8e-9770-67f0a091813c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:18.435372 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e428c56-ba55-4c8e-9770-67f0a091813c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:18.436337 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e428c56-ba55-4c8e-9770-67f0a091813c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:18.437371 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e428c56-ba55-4c8e-9770-67f0a091813c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:18.438344 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e428c56-ba55-4c8e-9770-67f0a091813c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:18.537908 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-58618121-9920-4d47-98d6-98ece61fef3e tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:18.539290 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-58618121-9920-4d47-98d6-98ece61fef3e tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:18.552897 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58618121-9920-4d47-98d6-98ece61fef3e tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:18.556168 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58618121-9920-4d47-98d6-98ece61fef3e tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:18.559344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58618121-9920-4d47-98d6-98ece61fef3e tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:18.564943 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58618121-9920-4d47-98d6-98ece61fef3e tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:18.568724 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58618121-9920-4d47-98d6-98ece61fef3e tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:18.569739 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-58618121-9920-4d47-98d6-98ece61fef3e tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:18.775333 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-58618121-9920-4d47-98d6-98ece61fef3e tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lazy-loading 'services' on Instance uuid d7f12266-677e-473d-8fbd-bf3136398e58 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:18:18.993616 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-58618121-9920-4d47-98d6-98ece61fef3e tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/os-volume_attachments/6efade23-db87-4836-ae05-0e99aaff0d92" status: 202 len: 0 microversion: 2.1 time: 0.462061 Sep 09 13:18:18.994896 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 225/448] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 13:18:18 2022] DELETE /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/os-volume_attachments/6efade23-db87-4836-ae05-0e99aaff0d92 => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:18:19.170578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1e428c56-ba55-4c8e-9770-67f0a091813c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:19.185082 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1e428c56-ba55-4c8e-9770-67f0a091813c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:19.187993 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1e428c56-ba55-4c8e-9770-67f0a091813c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:19.193475 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1e428c56-ba55-4c8e-9770-67f0a091813c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.795509 Sep 09 13:18:19.196104 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 224/449] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:18 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:20.225526 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a384bbdb-dd2f-43f0-9756-4c75624f1f36 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:20.226984 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a384bbdb-dd2f-43f0-9756-4c75624f1f36 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:20.241189 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a384bbdb-dd2f-43f0-9756-4c75624f1f36 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:20.247001 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a384bbdb-dd2f-43f0-9756-4c75624f1f36 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:20.247681 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a384bbdb-dd2f-43f0-9756-4c75624f1f36 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:20.249186 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a384bbdb-dd2f-43f0-9756-4c75624f1f36 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:20.249800 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a384bbdb-dd2f-43f0-9756-4c75624f1f36 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:20.250396 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a384bbdb-dd2f-43f0-9756-4c75624f1f36 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:20.619414 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a384bbdb-dd2f-43f0-9756-4c75624f1f36 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:20.634656 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a384bbdb-dd2f-43f0-9756-4c75624f1f36 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:20.646806 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a384bbdb-dd2f-43f0-9756-4c75624f1f36 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:20.661260 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a384bbdb-dd2f-43f0-9756-4c75624f1f36 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.440011 Sep 09 13:18:20.688256 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 226/450] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:20 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:21.701506 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c344db71-bf93-496c-bf3e-666e9a19b61a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:21.713567 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c344db71-bf93-496c-bf3e-666e9a19b61a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:21.726223 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c344db71-bf93-496c-bf3e-666e9a19b61a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:21.727037 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c344db71-bf93-496c-bf3e-666e9a19b61a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:21.727673 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c344db71-bf93-496c-bf3e-666e9a19b61a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:21.728917 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c344db71-bf93-496c-bf3e-666e9a19b61a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:21.730171 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c344db71-bf93-496c-bf3e-666e9a19b61a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:21.730891 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c344db71-bf93-496c-bf3e-666e9a19b61a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:22.029305 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c344db71-bf93-496c-bf3e-666e9a19b61a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:22.040144 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c344db71-bf93-496c-bf3e-666e9a19b61a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:22.041824 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c344db71-bf93-496c-bf3e-666e9a19b61a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:22.043763 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c344db71-bf93-496c-bf3e-666e9a19b61a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.349386 Sep 09 13:18:22.044767 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 225/451] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:21 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:22.805588 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ed49600-e1c6-439d-a73b-98f6c2167429 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aad19ef-b91e-4cef-beb9-85e941901338", "device": "/dev/sdb"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:22.810795 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6ed49600-e1c6-439d-a73b-98f6c2167429 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:22.828173 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ed49600-e1c6-439d-a73b-98f6c2167429 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:22.828670 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ed49600-e1c6-439d-a73b-98f6c2167429 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:22.829096 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ed49600-e1c6-439d-a73b-98f6c2167429 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:22.836188 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ed49600-e1c6-439d-a73b-98f6c2167429 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:22.836914 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ed49600-e1c6-439d-a73b-98f6c2167429 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:22.837504 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ed49600-e1c6-439d-a73b-98f6c2167429 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:23.071874 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0a4e7e6f-b3f3-41af-a13b-cb5ea01c2b44 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:23.073159 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0a4e7e6f-b3f3-41af-a13b-cb5ea01c2b44 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:23.083437 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a4e7e6f-b3f3-41af-a13b-cb5ea01c2b44 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:23.084251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a4e7e6f-b3f3-41af-a13b-cb5ea01c2b44 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:23.084956 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a4e7e6f-b3f3-41af-a13b-cb5ea01c2b44 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:23.086085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a4e7e6f-b3f3-41af-a13b-cb5ea01c2b44 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:23.086873 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a4e7e6f-b3f3-41af-a13b-cb5ea01c2b44 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:23.090551 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0a4e7e6f-b3f3-41af-a13b-cb5ea01c2b44 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:23.278543 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0a4e7e6f-b3f3-41af-a13b-cb5ea01c2b44 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:23.288691 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0a4e7e6f-b3f3-41af-a13b-cb5ea01c2b44 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:23.290464 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0a4e7e6f-b3f3-41af-a13b-cb5ea01c2b44 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:23.292055 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0a4e7e6f-b3f3-41af-a13b-cb5ea01c2b44 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.225987 Sep 09 13:18:23.293235 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 226/452] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:23 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:24.185693 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cd1b7b26-02f6-4b7c-8e49-9cc21c748bda tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Action: 'create', calling method: .version_select at 0x7fd4a197cee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1196201159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzNLxCA2kBXamrXi1LWCMKbOfP+zT5J92mY0yYeQ+2c7AghJ1m7iMbGkUrGuRAlr/1ses4sPHIb8Rwcb7Ef6MgBgC/15KmiMshZM5SsypIMc2W2LEuvN/X/zsMzWXZPMA=="}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:24.208036 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-cd1b7b26-02f6-4b7c-8e49-9cc21c748bda tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Getting quotas for project 4cc8da7b799a4bf49ce080e37a36c1d0. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:18:24.220986 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-cd1b7b26-02f6-4b7c-8e49-9cc21c748bda tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Getting quotas for user 3edc8b9046ac4112a838a9c3b39aecf0 and project 4cc8da7b799a4bf49ce080e37a36c1d0. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:18:24.264354 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cd1b7b26-02f6-4b7c-8e49-9cc21c748bda tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.349251 Sep 09 13:18:24.265355 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 227/453] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 13:18:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:24.320815 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2fee2aab-e3c9-47f6-a002-19ed37cc4582 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:24.321778 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2fee2aab-e3c9-47f6-a002-19ed37cc4582 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:24.329773 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fee2aab-e3c9-47f6-a002-19ed37cc4582 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:24.330904 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fee2aab-e3c9-47f6-a002-19ed37cc4582 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:24.331669 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fee2aab-e3c9-47f6-a002-19ed37cc4582 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:24.333444 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fee2aab-e3c9-47f6-a002-19ed37cc4582 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:24.335069 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fee2aab-e3c9-47f6-a002-19ed37cc4582 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:24.336189 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2fee2aab-e3c9-47f6-a002-19ed37cc4582 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:24.615707 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2fee2aab-e3c9-47f6-a002-19ed37cc4582 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:24.635482 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2fee2aab-e3c9-47f6-a002-19ed37cc4582 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:24.637850 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2fee2aab-e3c9-47f6-a002-19ed37cc4582 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:24.642966 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2fee2aab-e3c9-47f6-a002-19ed37cc4582 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.327924 Sep 09 13:18:24.645101 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 228/454] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:24 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:25.086059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ed49600-e1c6-439d-a73b-98f6c2167429 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "POST /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.284253 Sep 09 13:18:25.086682 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 227/455] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 13:18:22 2022] POST /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436/os-volume_attachments => generated 194 bytes in 2286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:25.672985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1ac83945-ce91-4acc-b3e6-1d75a8546453 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:25.674213 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1ac83945-ce91-4acc-b3e6-1d75a8546453 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:25.684456 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ac83945-ce91-4acc-b3e6-1d75a8546453 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:25.687205 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ac83945-ce91-4acc-b3e6-1d75a8546453 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:25.687853 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ac83945-ce91-4acc-b3e6-1d75a8546453 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:25.688771 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ac83945-ce91-4acc-b3e6-1d75a8546453 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:25.689255 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ac83945-ce91-4acc-b3e6-1d75a8546453 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:25.689692 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1ac83945-ce91-4acc-b3e6-1d75a8546453 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:25.807246 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b34f5417-bc30-42d2-af42-edd842013ed1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:25.819839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b34f5417-bc30-42d2-af42-edd842013ed1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:25.822010 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b34f5417-bc30-42d2-af42-edd842013ed1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:25.822684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b34f5417-bc30-42d2-af42-edd842013ed1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:25.961422 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1ac83945-ce91-4acc-b3e6-1d75a8546453 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:25.965942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b34f5417-bc30-42d2-af42-edd842013ed1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Going to try to stop instance {{(pid=120625) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 13:18:25.972007 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1ac83945-ce91-4acc-b3e6-1d75a8546453 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:25.973708 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1ac83945-ce91-4acc-b3e6-1d75a8546453 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:25.975086 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1ac83945-ce91-4acc-b3e6-1d75a8546453 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.306008 Sep 09 13:18:25.987728 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 229/456] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:25 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:26.067594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b34f5417-bc30-42d2-af42-edd842013ed1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "POST /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/action" status: 202 len: 0 microversion: 2.1 time: 0.265979 Sep 09 13:18:26.069044 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 228/457] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 13:18:25 2022] POST /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:18:26.077937 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8bf8d942-5da4-408a-8509-00e64ac2e3f9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:26.078734 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8bf8d942-5da4-408a-8509-00e64ac2e3f9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:26.087595 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bf8d942-5da4-408a-8509-00e64ac2e3f9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:26.088339 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bf8d942-5da4-408a-8509-00e64ac2e3f9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:26.089589 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bf8d942-5da4-408a-8509-00e64ac2e3f9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:26.090705 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bf8d942-5da4-408a-8509-00e64ac2e3f9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:26.091346 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bf8d942-5da4-408a-8509-00e64ac2e3f9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:26.091933 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bf8d942-5da4-408a-8509-00e64ac2e3f9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:26.308821 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8bf8d942-5da4-408a-8509-00e64ac2e3f9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:26.318564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8bf8d942-5da4-408a-8509-00e64ac2e3f9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1677 microversion: 2.1 time: 0.245597 Sep 09 13:18:26.319080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 230/458] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:26 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1677 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:27.004218 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-39894b3d-e47d-4147-b65d-d81a1ed728e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:27.004799 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-39894b3d-e47d-4147-b65d-d81a1ed728e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:27.011465 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39894b3d-e47d-4147-b65d-d81a1ed728e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:27.012036 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39894b3d-e47d-4147-b65d-d81a1ed728e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:27.012728 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39894b3d-e47d-4147-b65d-d81a1ed728e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:27.013450 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39894b3d-e47d-4147-b65d-d81a1ed728e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:27.013903 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39894b3d-e47d-4147-b65d-d81a1ed728e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:27.014327 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39894b3d-e47d-4147-b65d-d81a1ed728e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:27.169164 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-39894b3d-e47d-4147-b65d-d81a1ed728e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:27.178311 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-39894b3d-e47d-4147-b65d-d81a1ed728e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:27.179787 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-39894b3d-e47d-4147-b65d-d81a1ed728e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:27.180963 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-39894b3d-e47d-4147-b65d-d81a1ed728e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.182266 Sep 09 13:18:27.191146 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 229/459] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:26 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:27.353146 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-51e8f6cf-896f-44df-8f5b-0b8c91d4f388 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:27.354341 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-51e8f6cf-896f-44df-8f5b-0b8c91d4f388 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:27.361091 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51e8f6cf-896f-44df-8f5b-0b8c91d4f388 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:27.361585 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51e8f6cf-896f-44df-8f5b-0b8c91d4f388 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:27.362027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51e8f6cf-896f-44df-8f5b-0b8c91d4f388 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:27.362719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51e8f6cf-896f-44df-8f5b-0b8c91d4f388 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:27.363251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51e8f6cf-896f-44df-8f5b-0b8c91d4f388 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:27.363859 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51e8f6cf-896f-44df-8f5b-0b8c91d4f388 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:27.531812 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-51e8f6cf-896f-44df-8f5b-0b8c91d4f388 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:27.540880 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-51e8f6cf-896f-44df-8f5b-0b8c91d4f388 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1677 microversion: 2.1 time: 0.191904 Sep 09 13:18:27.541464 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 231/460] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:27 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:28.208911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c7385e38-00b3-4521-b13a-2dd02b293420 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:28.209521 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c7385e38-00b3-4521-b13a-2dd02b293420 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:28.216696 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7385e38-00b3-4521-b13a-2dd02b293420 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:28.217459 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7385e38-00b3-4521-b13a-2dd02b293420 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:28.218051 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7385e38-00b3-4521-b13a-2dd02b293420 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:28.219246 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7385e38-00b3-4521-b13a-2dd02b293420 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:28.219856 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7385e38-00b3-4521-b13a-2dd02b293420 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:28.220276 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7385e38-00b3-4521-b13a-2dd02b293420 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:28.387812 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c7385e38-00b3-4521-b13a-2dd02b293420 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:28.398046 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c7385e38-00b3-4521-b13a-2dd02b293420 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:28.400696 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c7385e38-00b3-4521-b13a-2dd02b293420 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:28.403313 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c7385e38-00b3-4521-b13a-2dd02b293420 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.198141 Sep 09 13:18:28.404418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 230/461] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:28 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:28.568048 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-76f728fb-cc88-4a8b-a3dd-15b05a88e051 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:28.569309 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-76f728fb-cc88-4a8b-a3dd-15b05a88e051 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:28.578829 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-76f728fb-cc88-4a8b-a3dd-15b05a88e051 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:28.579354 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-76f728fb-cc88-4a8b-a3dd-15b05a88e051 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:28.579799 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-76f728fb-cc88-4a8b-a3dd-15b05a88e051 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:28.580507 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-76f728fb-cc88-4a8b-a3dd-15b05a88e051 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:28.580964 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-76f728fb-cc88-4a8b-a3dd-15b05a88e051 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:28.581594 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-76f728fb-cc88-4a8b-a3dd-15b05a88e051 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:28.765737 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-76f728fb-cc88-4a8b-a3dd-15b05a88e051 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:28.774186 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-76f728fb-cc88-4a8b-a3dd-15b05a88e051 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1677 microversion: 2.1 time: 0.213098 Sep 09 13:18:28.775272 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 232/462] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:28 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:29.429804 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2e668fe2-c874-4990-a875-b24af6a3d2e3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:29.431085 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2e668fe2-c874-4990-a875-b24af6a3d2e3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:29.439341 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e668fe2-c874-4990-a875-b24af6a3d2e3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:29.440235 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e668fe2-c874-4990-a875-b24af6a3d2e3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:29.440948 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e668fe2-c874-4990-a875-b24af6a3d2e3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:29.441873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e668fe2-c874-4990-a875-b24af6a3d2e3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:29.452123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e668fe2-c874-4990-a875-b24af6a3d2e3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:29.452582 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2e668fe2-c874-4990-a875-b24af6a3d2e3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:29.711218 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2e668fe2-c874-4990-a875-b24af6a3d2e3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:29.723881 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2e668fe2-c874-4990-a875-b24af6a3d2e3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:29.725814 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2e668fe2-c874-4990-a875-b24af6a3d2e3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:29.727219 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2e668fe2-c874-4990-a875-b24af6a3d2e3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.301490 Sep 09 13:18:29.735707 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 231/463] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:29 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:29.798499 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e34a933c-e63e-4be8-ad76-53d68a1b7c07 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:29.800039 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e34a933c-e63e-4be8-ad76-53d68a1b7c07 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:29.807541 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e34a933c-e63e-4be8-ad76-53d68a1b7c07 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:29.808279 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e34a933c-e63e-4be8-ad76-53d68a1b7c07 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:29.809007 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e34a933c-e63e-4be8-ad76-53d68a1b7c07 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:29.810391 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e34a933c-e63e-4be8-ad76-53d68a1b7c07 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:29.811011 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e34a933c-e63e-4be8-ad76-53d68a1b7c07 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:29.811632 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e34a933c-e63e-4be8-ad76-53d68a1b7c07 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:29.978438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e34a933c-e63e-4be8-ad76-53d68a1b7c07 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:29.990145 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e34a933c-e63e-4be8-ad76-53d68a1b7c07 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1677 microversion: 2.1 time: 0.195466 Sep 09 13:18:29.991646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 233/464] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:29 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:30.771448 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38ff471b-c125-44e6-9068-7f67a63dab29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:30.773024 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-38ff471b-c125-44e6-9068-7f67a63dab29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:30.783723 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ff471b-c125-44e6-9068-7f67a63dab29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:30.788419 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ff471b-c125-44e6-9068-7f67a63dab29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:30.789036 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ff471b-c125-44e6-9068-7f67a63dab29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:30.789909 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ff471b-c125-44e6-9068-7f67a63dab29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:30.790507 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ff471b-c125-44e6-9068-7f67a63dab29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:30.792184 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38ff471b-c125-44e6-9068-7f67a63dab29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:30.947432 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-38ff471b-c125-44e6-9068-7f67a63dab29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:30.957878 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-38ff471b-c125-44e6-9068-7f67a63dab29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:30.960989 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-38ff471b-c125-44e6-9068-7f67a63dab29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:30.962608 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-38ff471b-c125-44e6-9068-7f67a63dab29 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.202282 Sep 09 13:18:30.963330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 232/465] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:30 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:31.014482 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f93da540-f8cf-45de-8329-7053fdab826d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:31.015037 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f93da540-f8cf-45de-8329-7053fdab826d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:31.023774 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f93da540-f8cf-45de-8329-7053fdab826d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:31.024281 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f93da540-f8cf-45de-8329-7053fdab826d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:31.024869 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f93da540-f8cf-45de-8329-7053fdab826d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:31.025753 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f93da540-f8cf-45de-8329-7053fdab826d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:31.025893 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f93da540-f8cf-45de-8329-7053fdab826d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:31.027346 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f93da540-f8cf-45de-8329-7053fdab826d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:31.205784 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f93da540-f8cf-45de-8329-7053fdab826d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:31.215831 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f93da540-f8cf-45de-8329-7053fdab826d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1677 microversion: 2.1 time: 0.205836 Sep 09 13:18:31.228338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 234/466] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:31 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:31.676765 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cbd73347-7f4c-4324-87f1-4da301b60e25 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Action: 'create', calling method: .version_select at 0x7fd4a180fca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1174718554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqxA/trcjeZ/2mTaPYucbqvMGbxD3Nu/PtabLFz4I4Ij9pr2e0Ac0bYUXjk7B1fEkoFFq41aPJzh+EInpuSNi93SpPdGCkPjxfBaFuZxNvLM7EkYF0FzgqjmzJYKa1M8w=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:31.692817 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-cbd73347-7f4c-4324-87f1-4da301b60e25 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Getting quotas for project e7c4b6192be646b38d7757960e02feda. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:18:31.696925 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-cbd73347-7f4c-4324-87f1-4da301b60e25 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Getting quotas for user b754de037a8148358efb03ffa39786d4 and project e7c4b6192be646b38d7757960e02feda. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:18:31.721167 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cbd73347-7f4c-4324-87f1-4da301b60e25 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048060 Sep 09 13:18:31.721766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 233/467] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 13:18:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:31.776065 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-779595866", "imageRef": "403f0a03-a483-4640-85d4-8c4bb097b259", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1174718554", "networks": [{"uuid": "f6e3ae91-48d1-421d-89ec-f2d1f579e368"}]}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:31.841043 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] validate_networks() for [('f6e3ae91-48d1-421d-89ec-f2d1f579e368', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:18:31.989276 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-958be46a-25f4-4b1a-8575-9e638338bac4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:31.989850 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-958be46a-25f4-4b1a-8575-9e638338bac4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:31.998194 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-958be46a-25f4-4b1a-8575-9e638338bac4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:31.998770 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-958be46a-25f4-4b1a-8575-9e638338bac4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:31.999438 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-958be46a-25f4-4b1a-8575-9e638338bac4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:32.000402 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-958be46a-25f4-4b1a-8575-9e638338bac4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:32.000919 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-958be46a-25f4-4b1a-8575-9e638338bac4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:32.001405 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-958be46a-25f4-4b1a-8575-9e638338bac4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:32.164351 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-958be46a-25f4-4b1a-8575-9e638338bac4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:32.174590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-958be46a-25f4-4b1a-8575-9e638338bac4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:32.176618 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-958be46a-25f4-4b1a-8575-9e638338bac4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:32.178360 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-958be46a-25f4-4b1a-8575-9e638338bac4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.192899 Sep 09 13:18:32.194194 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 234/468] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:31 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:18:32.242775 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1c922c0b-2480-4c33-8949-02dbd49d43e4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:32.243871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1c922c0b-2480-4c33-8949-02dbd49d43e4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:32.252783 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c922c0b-2480-4c33-8949-02dbd49d43e4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:32.253343 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c922c0b-2480-4c33-8949-02dbd49d43e4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:32.253887 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c922c0b-2480-4c33-8949-02dbd49d43e4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:32.254631 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c922c0b-2480-4c33-8949-02dbd49d43e4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:32.255332 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c922c0b-2480-4c33-8949-02dbd49d43e4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:32.255827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c922c0b-2480-4c33-8949-02dbd49d43e4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:32.263474 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:18:32.263960 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:18:32.264360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:18:32.264766 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:18:32.265380 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:18:32.274341 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:32.274827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:32.275299 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:32.276022 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:32.276774 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:32.277372 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:32.294517 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Getting quotas for project e7c4b6192be646b38d7757960e02feda. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:18:32.298773 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Getting quotas for user b754de037a8148358efb03ffa39786d4 and project e7c4b6192be646b38d7757960e02feda. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:18:32.310819 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:18:32.313184 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='403f0a03-a483-4640-85d4-8c4bb097b259',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:18:32.361519 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-51d8a1c7-32e5-4804-bf8b-450879431194 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589157 Sep 09 13:18:32.362451 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 235/469] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:18:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:18:32.373085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bebd03c2-f366-46a7-bd81-d0e9aed3656f tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:32.373702 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bebd03c2-f366-46a7-bd81-d0e9aed3656f tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:32.408599 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1c922c0b-2480-4c33-8949-02dbd49d43e4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:32.421761 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1c922c0b-2480-4c33-8949-02dbd49d43e4 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1677 microversion: 2.1 time: 0.184254 Sep 09 13:18:32.422735 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 235/470] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:32 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:32.434582 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-bebd03c2-f366-46a7-bd81-d0e9aed3656f tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:32.442670 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bebd03c2-f366-46a7-bd81-d0e9aed3656f tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1258 microversion: 2.1 time: 0.073356 Sep 09 13:18:32.443545 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 236/471] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:32 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:33.205848 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d1fbc634-6310-466e-9a38-363493f46f38 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:33.206589 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d1fbc634-6310-466e-9a38-363493f46f38 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:33.212920 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1fbc634-6310-466e-9a38-363493f46f38 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:33.213413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1fbc634-6310-466e-9a38-363493f46f38 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:33.214940 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1fbc634-6310-466e-9a38-363493f46f38 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:33.215891 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1fbc634-6310-466e-9a38-363493f46f38 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:33.216400 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1fbc634-6310-466e-9a38-363493f46f38 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:33.216840 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1fbc634-6310-466e-9a38-363493f46f38 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:33.235729 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:33.357901 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d1fbc634-6310-466e-9a38-363493f46f38 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:33.365980 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d1fbc634-6310-466e-9a38-363493f46f38 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:33.367466 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d1fbc634-6310-466e-9a38-363493f46f38 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:33.368863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d1fbc634-6310-466e-9a38-363493f46f38 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.166918 Sep 09 13:18:33.369418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 236/472] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:33 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:33.444827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d4828c60-cfd2-4df3-b258-c201d8abd58a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:33.445441 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d4828c60-cfd2-4df3-b258-c201d8abd58a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:33.452478 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4828c60-cfd2-4df3-b258-c201d8abd58a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:33.452961 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4828c60-cfd2-4df3-b258-c201d8abd58a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:33.453396 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4828c60-cfd2-4df3-b258-c201d8abd58a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:33.454081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4828c60-cfd2-4df3-b258-c201d8abd58a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:33.454535 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4828c60-cfd2-4df3-b258-c201d8abd58a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:33.454962 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4828c60-cfd2-4df3-b258-c201d8abd58a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:33.467253 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-18222927-5c9d-425f-a753-bb5addf50c7d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:33.467882 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-18222927-5c9d-425f-a753-bb5addf50c7d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:33.473936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18222927-5c9d-425f-a753-bb5addf50c7d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:33.474449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18222927-5c9d-425f-a753-bb5addf50c7d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:33.474881 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18222927-5c9d-425f-a753-bb5addf50c7d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:33.475645 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18222927-5c9d-425f-a753-bb5addf50c7d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:33.476099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18222927-5c9d-425f-a753-bb5addf50c7d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:33.476523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18222927-5c9d-425f-a753-bb5addf50c7d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:33.544849 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-18222927-5c9d-425f-a753-bb5addf50c7d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:33.552506 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-18222927-5c9d-425f-a753-bb5addf50c7d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1310 microversion: 2.1 time: 0.090387 Sep 09 13:18:33.553075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 237/473] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:33 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:33.590298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d4828c60-cfd2-4df3-b258-c201d8abd58a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:33.598259 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d4828c60-cfd2-4df3-b258-c201d8abd58a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1677 microversion: 2.1 time: 0.157268 Sep 09 13:18:33.598827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 237/474] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:33 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:34.186292 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c7d3f6d-2bdf-44b3-8cec-ed01043b1814 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:34.186805 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5c7d3f6d-2bdf-44b3-8cec-ed01043b1814 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:34.192745 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c7d3f6d-2bdf-44b3-8cec-ed01043b1814 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:34.193251 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c7d3f6d-2bdf-44b3-8cec-ed01043b1814 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:34.193686 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c7d3f6d-2bdf-44b3-8cec-ed01043b1814 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:34.194374 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c7d3f6d-2bdf-44b3-8cec-ed01043b1814 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:34.194831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c7d3f6d-2bdf-44b3-8cec-ed01043b1814 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:34.195359 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c7d3f6d-2bdf-44b3-8cec-ed01043b1814 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:34.220110 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5c7d3f6d-2bdf-44b3-8cec-ed01043b1814 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d/ips" status: 200 len: 151 microversion: 2.1 time: 0.037601 Sep 09 13:18:34.220732 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 238/475] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 13:18:34 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:34.233129 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c1d9b055-d68f-473d-8322-0b2958775d00 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b2a05b6-dc71-4e8a-be9c-d0cb28c02b64"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:34.235610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c1d9b055-d68f-473d-8322-0b2958775d00 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:34.241573 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c1d9b055-d68f-473d-8322-0b2958775d00 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:34.242044 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c1d9b055-d68f-473d-8322-0b2958775d00 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:34.242474 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c1d9b055-d68f-473d-8322-0b2958775d00 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:34.243440 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c1d9b055-d68f-473d-8322-0b2958775d00 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:34.243885 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c1d9b055-d68f-473d-8322-0b2958775d00 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:34.244302 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c1d9b055-d68f-473d-8322-0b2958775d00 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:34.322484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-c1d9b055-d68f-473d-8322-0b2958775d00 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] HTTP exception thrown: Invalid volume: volume 2b2a05b6-dc71-4e8a-be9c-d0cb28c02b64 is already attached to instances: 14183836-171b-4a21-ae32-a214060081e8 Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c1d9b055-d68f-473d-8322-0b2958775d00 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Request method failure captured: Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: POST /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d/os-volume_attachments HTTP/1.1 Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 74 Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxOEkSw_D0B2DWW3aDp6JHSyeYSFkFADbNPgrw4so5mlP-Ugc06W6Rkqydb-b3AAsVzR7p1RzJdXA1668TSyot_sK8AkXdZkK5Jg9C97nHfO5kDuLQSdUnou_VoOzEQjYwBo46vUgiPeKNiJ0QlKMZ9JN2CFXzSZOPwjJ0bmZDR7mw Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:18:34.324257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:18:34.325872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6b24b42ca93941aa8e70f5fa10303f4d", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:18:34.325872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:18:34.325872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:18:34.325872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:18:34.325872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:18:34.325872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:18:34.325872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:18:34.325872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: dcb88983a8e1439588644b71170d7362 Sep 09 13:18:34.325872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:18:34.325872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Sep 09 13:18:34.325872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {"volumeAttachment": {"volumeId": "2b2a05b6-dc71-4e8a-be9c-d0cb28c02b64"}} Sep 09 13:18:34.325872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Invalid volume: volume 2b2a05b6-dc71-4e8a-be9c-d0cb28c02b64 is already attached to instances: 14183836-171b-4a21-ae32-a214060081e8 Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'server_id': '67dfd749-af70-47be-a3de-523bc6cbd77d', 'body': {'volumeAttachment': {'volumeId': '2b2a05b6-dc71-4e8a-be9c-d0cb28c02b64'}}} Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2b2a05b6-dc71-4e8a-be9c-d0cb28c02b64 is already attached to instances: 14183836-171b-4a21-ae32-a214060081e8 Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:18:34.326866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2b2a05b6-dc71-4e8a-be9c-d0cb28c02b64 is already attached to instances: 14183836-171b-4a21-ae32-a214060081e8 Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:18:34.328176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:18:34.329710 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:18:34.329710 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:18:34.329710 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:18:34.329710 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2b2a05b6-dc71-4e8a-be9c-d0cb28c02b64 is already attached to instances: 14183836-171b-4a21-ae32-a214060081e8 Sep 09 13:18:34.329710 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:18:34.329710 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c1d9b055-d68f-473d-8322-0b2958775d00 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Returning 400 to user: Invalid volume: volume 2b2a05b6-dc71-4e8a-be9c-d0cb28c02b64 is already attached to instances: 14183836-171b-4a21-ae32-a214060081e8 {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:18:34.329710 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c1d9b055-d68f-473d-8322-0b2958775d00 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "POST /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097549 Sep 09 13:18:34.329710 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 238/476] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 13:18:34 2022] POST /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:18:34.334647 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-50409f4e-ac8a-4f93-b699-929ef26ac8fb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:34.335176 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-50409f4e-ac8a-4f93-b699-929ef26ac8fb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:34.341644 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50409f4e-ac8a-4f93-b699-929ef26ac8fb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:34.342123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50409f4e-ac8a-4f93-b699-929ef26ac8fb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:34.342554 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50409f4e-ac8a-4f93-b699-929ef26ac8fb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:34.343265 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50409f4e-ac8a-4f93-b699-929ef26ac8fb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:34.343949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50409f4e-ac8a-4f93-b699-929ef26ac8fb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:34.344372 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-50409f4e-ac8a-4f93-b699-929ef26ac8fb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:34.371005 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-50409f4e-ac8a-4f93-b699-929ef26ac8fb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:18:34.396658 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-921cee15-cc74-4839-bc75-f5292f91bac0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:34.397509 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-921cee15-cc74-4839-bc75-f5292f91bac0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:34.407032 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-921cee15-cc74-4839-bc75-f5292f91bac0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:34.407643 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-921cee15-cc74-4839-bc75-f5292f91bac0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:34.408198 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-921cee15-cc74-4839-bc75-f5292f91bac0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:34.409208 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-921cee15-cc74-4839-bc75-f5292f91bac0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:34.409766 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-921cee15-cc74-4839-bc75-f5292f91bac0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:34.410252 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-921cee15-cc74-4839-bc75-f5292f91bac0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:34.450071 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-50409f4e-ac8a-4f93-b699-929ef26ac8fb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 204 len: 0 microversion: 2.1 time: 0.118824 Sep 09 13:18:34.450657 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 239/477] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:18:34 2022] DELETE /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:18:34.459399 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ffe0db7-ca47-480a-9c35-e59965404f97 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:34.460041 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5ffe0db7-ca47-480a-9c35-e59965404f97 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:34.467398 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ffe0db7-ca47-480a-9c35-e59965404f97 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:34.467889 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ffe0db7-ca47-480a-9c35-e59965404f97 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:34.468322 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ffe0db7-ca47-480a-9c35-e59965404f97 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:34.469028 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ffe0db7-ca47-480a-9c35-e59965404f97 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:34.469480 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ffe0db7-ca47-480a-9c35-e59965404f97 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:34.469910 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ffe0db7-ca47-480a-9c35-e59965404f97 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:34.555539 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-921cee15-cc74-4839-bc75-f5292f91bac0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:34.564144 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-921cee15-cc74-4839-bc75-f5292f91bac0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:34.565603 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-921cee15-cc74-4839-bc75-f5292f91bac0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:34.566835 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-921cee15-cc74-4839-bc75-f5292f91bac0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.174768 Sep 09 13:18:34.567596 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 239/478] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:34 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:34.577760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5a50d877-bf25-4bf5-9c5e-2aac2cf9aabf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:34.578717 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5a50d877-bf25-4bf5-9c5e-2aac2cf9aabf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:34.585283 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a50d877-bf25-4bf5-9c5e-2aac2cf9aabf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:34.585976 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a50d877-bf25-4bf5-9c5e-2aac2cf9aabf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:34.586463 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a50d877-bf25-4bf5-9c5e-2aac2cf9aabf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:34.587198 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a50d877-bf25-4bf5-9c5e-2aac2cf9aabf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:34.587650 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a50d877-bf25-4bf5-9c5e-2aac2cf9aabf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:34.588073 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5a50d877-bf25-4bf5-9c5e-2aac2cf9aabf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:34.615908 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ffe0db7-ca47-480a-9c35-e59965404f97 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:34.624955 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ffe0db7-ca47-480a-9c35-e59965404f97 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1683 microversion: 2.1 time: 0.169800 Sep 09 13:18:34.625825 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 240/479] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:34 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:34.630442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b66aab54-2f9e-4811-b7c4-e9e43aefb80d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:34.631149 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b66aab54-2f9e-4811-b7c4-e9e43aefb80d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:34.642502 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b66aab54-2f9e-4811-b7c4-e9e43aefb80d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:34.642993 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b66aab54-2f9e-4811-b7c4-e9e43aefb80d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:34.643631 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b66aab54-2f9e-4811-b7c4-e9e43aefb80d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:34.644336 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b66aab54-2f9e-4811-b7c4-e9e43aefb80d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:34.644796 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b66aab54-2f9e-4811-b7c4-e9e43aefb80d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:34.645224 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b66aab54-2f9e-4811-b7c4-e9e43aefb80d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:34.665927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5a50d877-bf25-4bf5-9c5e-2aac2cf9aabf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:34.673919 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5a50d877-bf25-4bf5-9c5e-2aac2cf9aabf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1310 microversion: 2.1 time: 0.101627 Sep 09 13:18:34.674672 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 240/480] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:34 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1310 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:34.778888 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b66aab54-2f9e-4811-b7c4-e9e43aefb80d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:34.786481 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b66aab54-2f9e-4811-b7c4-e9e43aefb80d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1677 microversion: 2.1 time: 0.159717 Sep 09 13:18:34.787035 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 241/481] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:34 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:35.593802 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e6067e4f-a57c-4786-a106-d94d3c783805 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:35.594414 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e6067e4f-a57c-4786-a106-d94d3c783805 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:35.601481 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6067e4f-a57c-4786-a106-d94d3c783805 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:35.602233 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6067e4f-a57c-4786-a106-d94d3c783805 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:35.602608 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6067e4f-a57c-4786-a106-d94d3c783805 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:35.603419 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6067e4f-a57c-4786-a106-d94d3c783805 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:35.603960 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6067e4f-a57c-4786-a106-d94d3c783805 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:35.604615 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e6067e4f-a57c-4786-a106-d94d3c783805 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:35.648883 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-26c26ef4-71f1-457e-83b0-3fe5d9079ead tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:35.649490 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-26c26ef4-71f1-457e-83b0-3fe5d9079ead tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:35.656106 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26c26ef4-71f1-457e-83b0-3fe5d9079ead tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:35.656583 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26c26ef4-71f1-457e-83b0-3fe5d9079ead tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:35.657009 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26c26ef4-71f1-457e-83b0-3fe5d9079ead tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:35.657697 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26c26ef4-71f1-457e-83b0-3fe5d9079ead tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:35.658139 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26c26ef4-71f1-457e-83b0-3fe5d9079ead tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:35.658556 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-26c26ef4-71f1-457e-83b0-3fe5d9079ead tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:35.743724 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e6067e4f-a57c-4786-a106-d94d3c783805 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:35.752377 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e6067e4f-a57c-4786-a106-d94d3c783805 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:35.753815 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e6067e4f-a57c-4786-a106-d94d3c783805 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:35.754970 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e6067e4f-a57c-4786-a106-d94d3c783805 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.165936 Sep 09 13:18:35.755553 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 241/482] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:35 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:35.764861 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9e27871e-7db7-404a-96f5-3c7939b69941 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:35.765749 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9e27871e-7db7-404a-96f5-3c7939b69941 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:35.772204 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9e27871e-7db7-404a-96f5-3c7939b69941 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:35.772686 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9e27871e-7db7-404a-96f5-3c7939b69941 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:35.773121 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9e27871e-7db7-404a-96f5-3c7939b69941 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:35.773820 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9e27871e-7db7-404a-96f5-3c7939b69941 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:35.774272 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9e27871e-7db7-404a-96f5-3c7939b69941 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:35.774704 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9e27871e-7db7-404a-96f5-3c7939b69941 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:35.796652 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:35.802765 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-26c26ef4-71f1-457e-83b0-3fe5d9079ead tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:35.811696 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-26c26ef4-71f1-457e-83b0-3fe5d9079ead tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1683 microversion: 2.1 time: 0.166614 Sep 09 13:18:35.812275 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 242/483] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:35 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:35.816699 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ed7e21d-18bf-4ac6-a4d7-0982df784356 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:35.817296 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ed7e21d-18bf-4ac6-a4d7-0982df784356 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:35.823970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ed7e21d-18bf-4ac6-a4d7-0982df784356 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:35.824599 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ed7e21d-18bf-4ac6-a4d7-0982df784356 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:35.825051 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ed7e21d-18bf-4ac6-a4d7-0982df784356 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:35.825735 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ed7e21d-18bf-4ac6-a4d7-0982df784356 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:35.826185 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ed7e21d-18bf-4ac6-a4d7-0982df784356 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:35.826612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ed7e21d-18bf-4ac6-a4d7-0982df784356 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:35.847176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9e27871e-7db7-404a-96f5-3c7939b69941 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:35.855012 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9e27871e-7db7-404a-96f5-3c7939b69941 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1310 microversion: 2.1 time: 0.094773 Sep 09 13:18:35.855610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 242/484] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:35 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1310 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:35.960940 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2ed7e21d-18bf-4ac6-a4d7-0982df784356 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:35.968898 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ed7e21d-18bf-4ac6-a4d7-0982df784356 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1677 microversion: 2.1 time: 0.155690 Sep 09 13:18:35.969541 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 243/485] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:35 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:36.780347 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-981cb388-4684-4fc2-b465-936ce85b94c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47a7b876-b956-4805-a76b-ac86fdc63886"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:36.781193 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0cc9f35d-a68b-42cb-9700-17c43ee57d41 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:36.781812 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0cc9f35d-a68b-42cb-9700-17c43ee57d41 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:36.786258 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-981cb388-4684-4fc2-b465-936ce85b94c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:36.789907 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-981cb388-4684-4fc2-b465-936ce85b94c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:36.790382 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-981cb388-4684-4fc2-b465-936ce85b94c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:36.790819 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-981cb388-4684-4fc2-b465-936ce85b94c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:36.791231 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cc9f35d-a68b-42cb-9700-17c43ee57d41 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:36.791536 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-981cb388-4684-4fc2-b465-936ce85b94c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:36.791727 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cc9f35d-a68b-42cb-9700-17c43ee57d41 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:36.792023 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-981cb388-4684-4fc2-b465-936ce85b94c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:36.792432 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cc9f35d-a68b-42cb-9700-17c43ee57d41 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:36.792722 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-981cb388-4684-4fc2-b465-936ce85b94c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:36.793128 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cc9f35d-a68b-42cb-9700-17c43ee57d41 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:36.793611 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cc9f35d-a68b-42cb-9700-17c43ee57d41 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:36.794027 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0cc9f35d-a68b-42cb-9700-17c43ee57d41 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:36.952806 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0cc9f35d-a68b-42cb-9700-17c43ee57d41 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:36.961269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0cc9f35d-a68b-42cb-9700-17c43ee57d41 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:36.962735 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0cc9f35d-a68b-42cb-9700-17c43ee57d41 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:36.964633 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0cc9f35d-a68b-42cb-9700-17c43ee57d41 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.187700 Sep 09 13:18:36.965637 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 244/486] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:36 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:18:36.970864 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c1a2c85d-d703-447a-8682-68c40a24b62f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:36.971482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c1a2c85d-d703-447a-8682-68c40a24b62f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:36.977808 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1a2c85d-d703-447a-8682-68c40a24b62f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:36.978424 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1a2c85d-d703-447a-8682-68c40a24b62f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:36.978862 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1a2c85d-d703-447a-8682-68c40a24b62f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:36.979718 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1a2c85d-d703-447a-8682-68c40a24b62f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:36.980151 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1a2c85d-d703-447a-8682-68c40a24b62f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:36.980574 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1a2c85d-d703-447a-8682-68c40a24b62f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:37.129368 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c1a2c85d-d703-447a-8682-68c40a24b62f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:37.138252 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c1a2c85d-d703-447a-8682-68c40a24b62f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1683 microversion: 2.1 time: 0.171342 Sep 09 13:18:37.138888 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 245/487] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:36 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:37.144127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e434d039-9a9c-4398-8966-9630d1f181a9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:37.144729 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e434d039-9a9c-4398-8966-9630d1f181a9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:37.150464 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e434d039-9a9c-4398-8966-9630d1f181a9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:37.150952 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e434d039-9a9c-4398-8966-9630d1f181a9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:37.151404 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e434d039-9a9c-4398-8966-9630d1f181a9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:37.152422 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e434d039-9a9c-4398-8966-9630d1f181a9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:37.152871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e434d039-9a9c-4398-8966-9630d1f181a9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:37.153311 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e434d039-9a9c-4398-8966-9630d1f181a9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:37.227861 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e434d039-9a9c-4398-8966-9630d1f181a9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:37.238739 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e434d039-9a9c-4398-8966-9630d1f181a9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1318 microversion: 2.1 time: 0.098358 Sep 09 13:18:37.239349 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 246/488] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:37 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1318 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:37.244011 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-86eecf32-e3a8-48ac-b0de-68359439e0d7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:37.244606 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-86eecf32-e3a8-48ac-b0de-68359439e0d7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:37.251341 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86eecf32-e3a8-48ac-b0de-68359439e0d7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:37.251833 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86eecf32-e3a8-48ac-b0de-68359439e0d7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:37.252268 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86eecf32-e3a8-48ac-b0de-68359439e0d7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:37.252967 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86eecf32-e3a8-48ac-b0de-68359439e0d7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:37.253429 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86eecf32-e3a8-48ac-b0de-68359439e0d7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:37.254170 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-86eecf32-e3a8-48ac-b0de-68359439e0d7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:37.419999 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-86eecf32-e3a8-48ac-b0de-68359439e0d7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:37.428364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-86eecf32-e3a8-48ac-b0de-68359439e0d7 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1677 microversion: 2.1 time: 0.187981 Sep 09 13:18:37.428922 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 247/489] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:37 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:37.989680 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5b78612e-a17f-42ef-a3da-a205fb4efa83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:37.990353 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5b78612e-a17f-42ef-a3da-a205fb4efa83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:38.000771 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b78612e-a17f-42ef-a3da-a205fb4efa83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:38.001261 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b78612e-a17f-42ef-a3da-a205fb4efa83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:38.001690 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b78612e-a17f-42ef-a3da-a205fb4efa83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:38.002388 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b78612e-a17f-42ef-a3da-a205fb4efa83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:38.002833 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b78612e-a17f-42ef-a3da-a205fb4efa83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:38.003275 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5b78612e-a17f-42ef-a3da-a205fb4efa83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:38.136187 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5b78612e-a17f-42ef-a3da-a205fb4efa83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:38.144173 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5b78612e-a17f-42ef-a3da-a205fb4efa83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:38.145612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5b78612e-a17f-42ef-a3da-a205fb4efa83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:38.146753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5b78612e-a17f-42ef-a3da-a205fb4efa83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.160964 Sep 09 13:18:38.147336 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 248/490] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:37 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:18:38.169979 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e724719a-89ee-4f50-b0e1-790730511a44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:38.170612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e724719a-89ee-4f50-b0e1-790730511a44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:38.176567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e724719a-89ee-4f50-b0e1-790730511a44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:38.177043 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e724719a-89ee-4f50-b0e1-790730511a44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:38.177479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e724719a-89ee-4f50-b0e1-790730511a44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:38.178160 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e724719a-89ee-4f50-b0e1-790730511a44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:38.178606 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e724719a-89ee-4f50-b0e1-790730511a44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:38.179028 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e724719a-89ee-4f50-b0e1-790730511a44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:38.318128 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e724719a-89ee-4f50-b0e1-790730511a44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:38.326421 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e724719a-89ee-4f50-b0e1-790730511a44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1683 microversion: 2.1 time: 0.161311 Sep 09 13:18:38.326992 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 249/491] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:38 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:38.331307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1eb91f10-7e47-4694-8f73-7faf871625c4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:38.331895 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1eb91f10-7e47-4694-8f73-7faf871625c4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:38.337209 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1eb91f10-7e47-4694-8f73-7faf871625c4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:38.337683 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1eb91f10-7e47-4694-8f73-7faf871625c4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:38.338110 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1eb91f10-7e47-4694-8f73-7faf871625c4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:38.339386 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1eb91f10-7e47-4694-8f73-7faf871625c4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:38.339850 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1eb91f10-7e47-4694-8f73-7faf871625c4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:38.340263 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1eb91f10-7e47-4694-8f73-7faf871625c4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:38.400383 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1eb91f10-7e47-4694-8f73-7faf871625c4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:38.408766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1eb91f10-7e47-4694-8f73-7faf871625c4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1318 microversion: 2.1 time: 0.080827 Sep 09 13:18:38.409324 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 250/492] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:38 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1318 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:38.464602 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c192f3c3-7082-4bf7-bd99-6ad618747578 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:38.465364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c192f3c3-7082-4bf7-bd99-6ad618747578 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:38.471411 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c192f3c3-7082-4bf7-bd99-6ad618747578 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:38.471893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c192f3c3-7082-4bf7-bd99-6ad618747578 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:38.472328 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c192f3c3-7082-4bf7-bd99-6ad618747578 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:38.473013 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c192f3c3-7082-4bf7-bd99-6ad618747578 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:38.473466 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c192f3c3-7082-4bf7-bd99-6ad618747578 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:38.473920 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c192f3c3-7082-4bf7-bd99-6ad618747578 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:38.610110 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c192f3c3-7082-4bf7-bd99-6ad618747578 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:38.614041 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:38.623663 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c192f3c3-7082-4bf7-bd99-6ad618747578 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1677 microversion: 2.1 time: 0.163342 Sep 09 13:18:38.624595 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 251/493] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:38 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:39.174148 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a65f38c5-1e7f-4843-beb7-4e80ea1d169a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:39.174820 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a65f38c5-1e7f-4843-beb7-4e80ea1d169a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:39.182129 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a65f38c5-1e7f-4843-beb7-4e80ea1d169a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:39.182699 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a65f38c5-1e7f-4843-beb7-4e80ea1d169a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:39.183660 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a65f38c5-1e7f-4843-beb7-4e80ea1d169a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:39.184355 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a65f38c5-1e7f-4843-beb7-4e80ea1d169a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:39.184807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a65f38c5-1e7f-4843-beb7-4e80ea1d169a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:39.185227 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a65f38c5-1e7f-4843-beb7-4e80ea1d169a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:39.316576 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a65f38c5-1e7f-4843-beb7-4e80ea1d169a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:39.324810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a65f38c5-1e7f-4843-beb7-4e80ea1d169a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:39.326278 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a65f38c5-1e7f-4843-beb7-4e80ea1d169a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:39.327466 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a65f38c5-1e7f-4843-beb7-4e80ea1d169a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.157562 Sep 09 13:18:39.328018 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 252/494] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:39 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:18:39.349325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-98e16040-1ee0-4863-b220-8176b06dd189 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:39.349921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-98e16040-1ee0-4863-b220-8176b06dd189 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:39.356562 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98e16040-1ee0-4863-b220-8176b06dd189 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:39.357040 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98e16040-1ee0-4863-b220-8176b06dd189 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:39.357471 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98e16040-1ee0-4863-b220-8176b06dd189 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:39.358153 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98e16040-1ee0-4863-b220-8176b06dd189 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:39.358603 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98e16040-1ee0-4863-b220-8176b06dd189 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:39.359024 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98e16040-1ee0-4863-b220-8176b06dd189 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:39.487123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-98e16040-1ee0-4863-b220-8176b06dd189 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:39.495511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-98e16040-1ee0-4863-b220-8176b06dd189 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1683 microversion: 2.1 time: 0.149572 Sep 09 13:18:39.496076 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 253/495] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:39 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:39.500472 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c587e743-e4a5-483a-80bb-8890dfa834d3 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:39.501099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c587e743-e4a5-483a-80bb-8890dfa834d3 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:39.506532 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c587e743-e4a5-483a-80bb-8890dfa834d3 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:39.507038 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c587e743-e4a5-483a-80bb-8890dfa834d3 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:39.507648 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c587e743-e4a5-483a-80bb-8890dfa834d3 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:39.508413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c587e743-e4a5-483a-80bb-8890dfa834d3 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:39.508948 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c587e743-e4a5-483a-80bb-8890dfa834d3 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:39.509458 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c587e743-e4a5-483a-80bb-8890dfa834d3 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:39.570012 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c587e743-e4a5-483a-80bb-8890dfa834d3 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:39.578004 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c587e743-e4a5-483a-80bb-8890dfa834d3 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1318 microversion: 2.1 time: 0.080953 Sep 09 13:18:39.578566 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 254/496] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:39 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1318 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:39.647946 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-03e871ef-ad7f-4ef4-ab6d-0f515322cbae tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:39.648552 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-03e871ef-ad7f-4ef4-ab6d-0f515322cbae tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:39.654987 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03e871ef-ad7f-4ef4-ab6d-0f515322cbae tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:39.655508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03e871ef-ad7f-4ef4-ab6d-0f515322cbae tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:39.655937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03e871ef-ad7f-4ef4-ab6d-0f515322cbae tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:39.656616 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03e871ef-ad7f-4ef4-ab6d-0f515322cbae tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:39.657067 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03e871ef-ad7f-4ef4-ab6d-0f515322cbae tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:39.657478 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-03e871ef-ad7f-4ef4-ab6d-0f515322cbae tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:39.792713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-03e871ef-ad7f-4ef4-ab6d-0f515322cbae tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:39.800423 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-03e871ef-ad7f-4ef4-ab6d-0f515322cbae tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1677 microversion: 2.1 time: 0.156660 Sep 09 13:18:39.801239 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 255/497] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:39 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:40.353374 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-84ee19a9-9e5e-4bda-9a06-89f675501da2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:40.353965 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-84ee19a9-9e5e-4bda-9a06-89f675501da2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:40.360382 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84ee19a9-9e5e-4bda-9a06-89f675501da2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:40.360853 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84ee19a9-9e5e-4bda-9a06-89f675501da2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:40.361280 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84ee19a9-9e5e-4bda-9a06-89f675501da2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:40.361953 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84ee19a9-9e5e-4bda-9a06-89f675501da2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:40.362395 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84ee19a9-9e5e-4bda-9a06-89f675501da2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:40.362807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-84ee19a9-9e5e-4bda-9a06-89f675501da2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:40.494205 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-84ee19a9-9e5e-4bda-9a06-89f675501da2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:40.502838 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-84ee19a9-9e5e-4bda-9a06-89f675501da2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:40.504317 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-84ee19a9-9e5e-4bda-9a06-89f675501da2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:40.505468 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-84ee19a9-9e5e-4bda-9a06-89f675501da2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.156208 Sep 09 13:18:40.506026 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 256/498] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:40 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:18:40.517345 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21210ada-f09b-49f7-b64d-b0869daccc1a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:40.517950 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-21210ada-f09b-49f7-b64d-b0869daccc1a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:40.524502 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21210ada-f09b-49f7-b64d-b0869daccc1a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:40.524988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21210ada-f09b-49f7-b64d-b0869daccc1a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:40.525424 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21210ada-f09b-49f7-b64d-b0869daccc1a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:40.526165 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21210ada-f09b-49f7-b64d-b0869daccc1a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:40.526879 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21210ada-f09b-49f7-b64d-b0869daccc1a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:40.527561 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21210ada-f09b-49f7-b64d-b0869daccc1a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:40.665270 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-21210ada-f09b-49f7-b64d-b0869daccc1a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:40.673954 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-21210ada-f09b-49f7-b64d-b0869daccc1a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1683 microversion: 2.1 time: 0.160068 Sep 09 13:18:40.674518 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 257/499] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:40 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:40.679183 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-91cc4c1d-fc74-46df-b2b0-e9e0d982afbf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:40.679817 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-91cc4c1d-fc74-46df-b2b0-e9e0d982afbf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:40.687375 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91cc4c1d-fc74-46df-b2b0-e9e0d982afbf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:40.687375 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91cc4c1d-fc74-46df-b2b0-e9e0d982afbf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:40.687723 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91cc4c1d-fc74-46df-b2b0-e9e0d982afbf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:40.688403 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91cc4c1d-fc74-46df-b2b0-e9e0d982afbf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:40.688860 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91cc4c1d-fc74-46df-b2b0-e9e0d982afbf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:40.689294 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91cc4c1d-fc74-46df-b2b0-e9e0d982afbf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:40.759599 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-91cc4c1d-fc74-46df-b2b0-e9e0d982afbf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:40.768409 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-91cc4c1d-fc74-46df-b2b0-e9e0d982afbf tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1318 microversion: 2.1 time: 0.092812 Sep 09 13:18:40.768993 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 258/500] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:40 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1318 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:40.824835 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2fce4308-b917-42e4-806f-2bf38bb5fa9f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:40.825549 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2fce4308-b917-42e4-806f-2bf38bb5fa9f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:40.834249 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fce4308-b917-42e4-806f-2bf38bb5fa9f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:40.836876 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fce4308-b917-42e4-806f-2bf38bb5fa9f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:40.837376 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fce4308-b917-42e4-806f-2bf38bb5fa9f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:40.839568 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fce4308-b917-42e4-806f-2bf38bb5fa9f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:40.839568 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fce4308-b917-42e4-806f-2bf38bb5fa9f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:40.839568 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2fce4308-b917-42e4-806f-2bf38bb5fa9f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:41.010869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2fce4308-b917-42e4-806f-2bf38bb5fa9f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:41.019114 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2fce4308-b917-42e4-806f-2bf38bb5fa9f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1677 microversion: 2.1 time: 0.198940 Sep 09 13:18:41.019682 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 259/501] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:40 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:41.065293 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-981cb388-4684-4fc2-b465-936ce85b94c4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "POST /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.290099 Sep 09 13:18:41.066040 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 243/502] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 13:18:36 2022] POST /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-volume_attachments => generated 194 bytes in 4292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:41.531216 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-670e688a-6e5c-4444-a269-96e8028cbe45 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:41.532617 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-670e688a-6e5c-4444-a269-96e8028cbe45 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:41.547512 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-670e688a-6e5c-4444-a269-96e8028cbe45 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:41.550053 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-670e688a-6e5c-4444-a269-96e8028cbe45 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:41.551658 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-670e688a-6e5c-4444-a269-96e8028cbe45 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:41.554346 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-670e688a-6e5c-4444-a269-96e8028cbe45 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:41.556315 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-670e688a-6e5c-4444-a269-96e8028cbe45 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:41.560741 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-670e688a-6e5c-4444-a269-96e8028cbe45 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:41.701763 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cfa7b130-79e2-4cfa-bb51-c6223bdd92ae tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:41.702875 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cfa7b130-79e2-4cfa-bb51-c6223bdd92ae tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:41.704472 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:41.713809 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cfa7b130-79e2-4cfa-bb51-c6223bdd92ae tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:41.715005 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cfa7b130-79e2-4cfa-bb51-c6223bdd92ae tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:41.715724 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cfa7b130-79e2-4cfa-bb51-c6223bdd92ae tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:41.716663 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cfa7b130-79e2-4cfa-bb51-c6223bdd92ae tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:41.717323 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cfa7b130-79e2-4cfa-bb51-c6223bdd92ae tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:41.717957 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cfa7b130-79e2-4cfa-bb51-c6223bdd92ae tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:41.879509 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-670e688a-6e5c-4444-a269-96e8028cbe45 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:41.896443 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-670e688a-6e5c-4444-a269-96e8028cbe45 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:41.900371 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-670e688a-6e5c-4444-a269-96e8028cbe45 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:41.903901 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-670e688a-6e5c-4444-a269-96e8028cbe45 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1744 microversion: 2.20 time: 0.377340 Sep 09 13:18:41.904960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 260/503] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:41 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1744 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:41.913123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38be6370-a0a7-41c2-a615-1e7b2d5c23ad tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:41.914004 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-38be6370-a0a7-41c2-a615-1e7b2d5c23ad tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:41.936681 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38be6370-a0a7-41c2-a615-1e7b2d5c23ad tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:41.937485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38be6370-a0a7-41c2-a615-1e7b2d5c23ad tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:41.938350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38be6370-a0a7-41c2-a615-1e7b2d5c23ad tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:41.939387 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38be6370-a0a7-41c2-a615-1e7b2d5c23ad tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:41.940215 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38be6370-a0a7-41c2-a615-1e7b2d5c23ad tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:41.940925 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38be6370-a0a7-41c2-a615-1e7b2d5c23ad tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:42.048510 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-38be6370-a0a7-41c2-a615-1e7b2d5c23ad tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:42.060504 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-38be6370-a0a7-41c2-a615-1e7b2d5c23ad tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1316 microversion: 2.1 time: 0.153294 Sep 09 13:18:42.074307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 261/504] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:41 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:42.074307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c3f8b21-a006-4c88-9a19-2c175ba09d93 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:42.074307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3c3f8b21-a006-4c88-9a19-2c175ba09d93 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:42.079347 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c3f8b21-a006-4c88-9a19-2c175ba09d93 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:42.080106 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c3f8b21-a006-4c88-9a19-2c175ba09d93 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:42.080547 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c3f8b21-a006-4c88-9a19-2c175ba09d93 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:42.081257 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c3f8b21-a006-4c88-9a19-2c175ba09d93 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:42.081762 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c3f8b21-a006-4c88-9a19-2c175ba09d93 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:42.082187 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c3f8b21-a006-4c88-9a19-2c175ba09d93 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:42.284770 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-cfa7b130-79e2-4cfa-bb51-c6223bdd92ae tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:42.291831 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:42.297490 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cfa7b130-79e2-4cfa-bb51-c6223bdd92ae tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1683 microversion: 2.1 time: 0.601867 Sep 09 13:18:42.301434 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 244/505] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:41 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1683 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:42.357684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3c3f8b21-a006-4c88-9a19-2c175ba09d93 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:42.369230 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c3f8b21-a006-4c88-9a19-2c175ba09d93 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1677 microversion: 2.1 time: 0.306618 Sep 09 13:18:42.369916 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 262/506] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:42 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1677 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:42.933860 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-569a24ea-c03d-4fb1-9107-b63302fb987a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:42.934828 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-569a24ea-c03d-4fb1-9107-b63302fb987a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:42.938583 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=12 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:42.943279 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-569a24ea-c03d-4fb1-9107-b63302fb987a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:42.943765 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-569a24ea-c03d-4fb1-9107-b63302fb987a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:42.944257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-569a24ea-c03d-4fb1-9107-b63302fb987a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:42.944969 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-569a24ea-c03d-4fb1-9107-b63302fb987a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:42.945438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-569a24ea-c03d-4fb1-9107-b63302fb987a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:42.945858 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-569a24ea-c03d-4fb1-9107-b63302fb987a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:43.086251 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f78ca13d-9f6f-49ba-bddc-5ddf6ed2695a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:43.087546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f78ca13d-9f6f-49ba-bddc-5ddf6ed2695a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:43.101428 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f78ca13d-9f6f-49ba-bddc-5ddf6ed2695a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:43.102351 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f78ca13d-9f6f-49ba-bddc-5ddf6ed2695a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:43.103023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f78ca13d-9f6f-49ba-bddc-5ddf6ed2695a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:43.104661 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f78ca13d-9f6f-49ba-bddc-5ddf6ed2695a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:43.106017 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f78ca13d-9f6f-49ba-bddc-5ddf6ed2695a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:43.107590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f78ca13d-9f6f-49ba-bddc-5ddf6ed2695a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:43.391699 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f78ca13d-9f6f-49ba-bddc-5ddf6ed2695a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:43.406082 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f78ca13d-9f6f-49ba-bddc-5ddf6ed2695a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.323963 Sep 09 13:18:43.407155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 263/507] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:43 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:43.416341 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-47209736-0877-435f-90cd-5924aa133109 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:43.419649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-47209736-0877-435f-90cd-5924aa133109 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:43.434038 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47209736-0877-435f-90cd-5924aa133109 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:43.437834 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47209736-0877-435f-90cd-5924aa133109 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:43.439797 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47209736-0877-435f-90cd-5924aa133109 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:43.440573 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47209736-0877-435f-90cd-5924aa133109 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:43.441044 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47209736-0877-435f-90cd-5924aa133109 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:43.441480 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-47209736-0877-435f-90cd-5924aa133109 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:43.581770 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-47209736-0877-435f-90cd-5924aa133109 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:43.595588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-569a24ea-c03d-4fb1-9107-b63302fb987a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:43.602217 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-47209736-0877-435f-90cd-5924aa133109 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1615 microversion: 2.1 time: 0.193808 Sep 09 13:18:43.602824 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 264/508] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:43 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1615 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:43.609381 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-569a24ea-c03d-4fb1-9107-b63302fb987a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:43.617132 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-569a24ea-c03d-4fb1-9107-b63302fb987a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:43.621413 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-569a24ea-c03d-4fb1-9107-b63302fb987a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1744 microversion: 2.20 time: 0.689979 Sep 09 13:18:43.637112 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-546a100e-d4e1-434b-9806-9d8e098ddf97 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:43.637112 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-546a100e-d4e1-434b-9806-9d8e098ddf97 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:43.637389 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:43.638530 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 245/509] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:42 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1744 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:43.639766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-546a100e-d4e1-434b-9806-9d8e098ddf97 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:43.640335 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-546a100e-d4e1-434b-9806-9d8e098ddf97 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:43.647148 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-546a100e-d4e1-434b-9806-9d8e098ddf97 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:43.647148 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-546a100e-d4e1-434b-9806-9d8e098ddf97 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:43.647148 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-546a100e-d4e1-434b-9806-9d8e098ddf97 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:43.647148 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-546a100e-d4e1-434b-9806-9d8e098ddf97 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:43.892811 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-546a100e-d4e1-434b-9806-9d8e098ddf97 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:43.903873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-546a100e-d4e1-434b-9806-9d8e098ddf97 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1654 microversion: 2.1 time: 0.299939 Sep 09 13:18:43.904472 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 265/510] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:43 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1654 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:43.920573 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-1cd6b5e2-1967-42f0-9039-936827e462d5 req-03419382-ccd5-4574-813a-06e6e01c987f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dfd749-af70-47be-a3de-523bc6cbd77d", "name": "network-vif-deleted", "tag": "9f010fe5-2104-4a34-a352-227d3c7e2fca"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:43.927694 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4eaafb0d-ca4e-4da3-a8b7-b935563f203f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:43.936256 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4eaafb0d-ca4e-4da3-a8b7-b935563f203f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:43.936754 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4eaafb0d-ca4e-4da3-a8b7-b935563f203f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:43.937194 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4eaafb0d-ca4e-4da3-a8b7-b935563f203f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:43.944430 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1cd6b5e2-1967-42f0-9039-936827e462d5 req-03419382-ccd5-4574-813a-06e6e01c987f service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:43.949969 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1cd6b5e2-1967-42f0-9039-936827e462d5 req-03419382-ccd5-4574-813a-06e6e01c987f service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:43.952821 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1cd6b5e2-1967-42f0-9039-936827e462d5 req-03419382-ccd5-4574-813a-06e6e01c987f service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:43.973973 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-1cd6b5e2-1967-42f0-9039-936827e462d5 req-03419382-ccd5-4574-813a-06e6e01c987f service nova] Creating event network-vif-deleted:9f010fe5-2104-4a34-a352-227d3c7e2fca for instance 67dfd749-af70-47be-a3de-523bc6cbd77d on hv-cinder-83124 Sep 09 13:18:43.993442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4eaafb0d-ca4e-4da3-a8b7-b935563f203f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Going to try to start instance {{(pid=120625) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 13:18:43.998562 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-1cd6b5e2-1967-42f0-9039-936827e462d5 req-03419382-ccd5-4574-813a-06e6e01c987f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082180 Sep 09 13:18:43.999768 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 246/511] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:44.079345 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4eaafb0d-ca4e-4da3-a8b7-b935563f203f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "POST /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/action" status: 202 len: 0 microversion: 2.1 time: 0.153600 Sep 09 13:18:44.080069 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 266/512] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 13:18:43 2022] POST /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 13:18:44.088636 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6662957c-0a62-48b4-ae6f-b17786994d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:44.089977 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6662957c-0a62-48b4-ae6f-b17786994d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:44.096594 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6662957c-0a62-48b4-ae6f-b17786994d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:44.097292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6662957c-0a62-48b4-ae6f-b17786994d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:44.097879 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6662957c-0a62-48b4-ae6f-b17786994d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:44.098729 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6662957c-0a62-48b4-ae6f-b17786994d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:44.099372 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6662957c-0a62-48b4-ae6f-b17786994d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:44.099945 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6662957c-0a62-48b4-ae6f-b17786994d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:44.394255 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6662957c-0a62-48b4-ae6f-b17786994d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:44.402818 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6662957c-0a62-48b4-ae6f-b17786994d4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1663 microversion: 2.1 time: 0.318254 Sep 09 13:18:44.418590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 247/513] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:44 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1663 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:44.438196 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-33d00b04-3767-418a-9643-d0b8c5cd893a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:44.442041 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-33d00b04-3767-418a-9643-d0b8c5cd893a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:44.452783 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d00b04-3767-418a-9643-d0b8c5cd893a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:44.453445 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d00b04-3767-418a-9643-d0b8c5cd893a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:44.453972 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d00b04-3767-418a-9643-d0b8c5cd893a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:44.454781 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d00b04-3767-418a-9643-d0b8c5cd893a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:44.455358 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d00b04-3767-418a-9643-d0b8c5cd893a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:44.455871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d00b04-3767-418a-9643-d0b8c5cd893a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:44.485459 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:44.633483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1d611bfa-55bc-4e2b-91a3-3eca5cb715ca tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:44.634113 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1d611bfa-55bc-4e2b-91a3-3eca5cb715ca tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:44.654431 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d611bfa-55bc-4e2b-91a3-3eca5cb715ca tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:44.655184 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d611bfa-55bc-4e2b-91a3-3eca5cb715ca tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:44.656109 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d611bfa-55bc-4e2b-91a3-3eca5cb715ca tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:44.657991 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d611bfa-55bc-4e2b-91a3-3eca5cb715ca tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:44.658993 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d611bfa-55bc-4e2b-91a3-3eca5cb715ca tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:44.659892 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d611bfa-55bc-4e2b-91a3-3eca5cb715ca tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:44.781384 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-33d00b04-3767-418a-9643-d0b8c5cd893a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:44.789659 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-33d00b04-3767-418a-9643-d0b8c5cd893a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.360403 Sep 09 13:18:44.790238 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 267/514] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:44 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:44.812873 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1d611bfa-55bc-4e2b-91a3-3eca5cb715ca tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:44.825031 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0ac9b63e-5617-47be-b86c-9130bed32706 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:44.825660 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0ac9b63e-5617-47be-b86c-9130bed32706 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:44.826082 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1d611bfa-55bc-4e2b-91a3-3eca5cb715ca tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1615 microversion: 2.1 time: 0.196543 Sep 09 13:18:44.831305 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 248/515] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:44 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1615 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:44.831831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ac9b63e-5617-47be-b86c-9130bed32706 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:44.832331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ac9b63e-5617-47be-b86c-9130bed32706 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:44.832767 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ac9b63e-5617-47be-b86c-9130bed32706 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:44.835955 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ac9b63e-5617-47be-b86c-9130bed32706 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:44.836442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ac9b63e-5617-47be-b86c-9130bed32706 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:44.836871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0ac9b63e-5617-47be-b86c-9130bed32706 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:45.089824 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0ac9b63e-5617-47be-b86c-9130bed32706 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:45.099354 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0ac9b63e-5617-47be-b86c-9130bed32706 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:45.100860 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0ac9b63e-5617-47be-b86c-9130bed32706 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:45.102477 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0ac9b63e-5617-47be-b86c-9130bed32706 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1744 microversion: 2.20 time: 0.295596 Sep 09 13:18:45.103584 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 268/516] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:44 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1744 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:45.436649 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-abb12c59-5c6d-49fd-b29f-f3bbae2b5be5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:45.437639 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-abb12c59-5c6d-49fd-b29f-f3bbae2b5be5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:45.447958 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:45.451671 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb12c59-5c6d-49fd-b29f-f3bbae2b5be5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:45.452512 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb12c59-5c6d-49fd-b29f-f3bbae2b5be5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:45.453204 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb12c59-5c6d-49fd-b29f-f3bbae2b5be5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:45.458901 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb12c59-5c6d-49fd-b29f-f3bbae2b5be5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:45.460166 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb12c59-5c6d-49fd-b29f-f3bbae2b5be5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:45.461211 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-abb12c59-5c6d-49fd-b29f-f3bbae2b5be5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:45.712737 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-abb12c59-5c6d-49fd-b29f-f3bbae2b5be5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:45.724406 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-abb12c59-5c6d-49fd-b29f-f3bbae2b5be5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1663 microversion: 2.1 time: 0.298014 Sep 09 13:18:45.730180 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 249/517] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:45 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1663 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:45.818157 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-331016e7-a79d-4d89-8c92-35d3ec91ad89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:45.819588 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-331016e7-a79d-4d89-8c92-35d3ec91ad89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:45.827394 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-331016e7-a79d-4d89-8c92-35d3ec91ad89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:45.828130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-331016e7-a79d-4d89-8c92-35d3ec91ad89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:45.828808 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-331016e7-a79d-4d89-8c92-35d3ec91ad89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:45.829681 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-331016e7-a79d-4d89-8c92-35d3ec91ad89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:45.830503 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-331016e7-a79d-4d89-8c92-35d3ec91ad89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:45.831106 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-331016e7-a79d-4d89-8c92-35d3ec91ad89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:45.860451 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-838996f3-e1a1-4642-8184-3f2385f48f20 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:45.861350 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-838996f3-e1a1-4642-8184-3f2385f48f20 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:45.871583 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-838996f3-e1a1-4642-8184-3f2385f48f20 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:45.872342 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-838996f3-e1a1-4642-8184-3f2385f48f20 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:45.877481 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-838996f3-e1a1-4642-8184-3f2385f48f20 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:45.878596 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-838996f3-e1a1-4642-8184-3f2385f48f20 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:45.879308 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-838996f3-e1a1-4642-8184-3f2385f48f20 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:45.879896 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-838996f3-e1a1-4642-8184-3f2385f48f20 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:46.023460 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-838996f3-e1a1-4642-8184-3f2385f48f20 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:46.043233 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-838996f3-e1a1-4642-8184-3f2385f48f20 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1615 microversion: 2.1 time: 0.179814 Sep 09 13:18:46.044092 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 250/518] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:45 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1615 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:46.095954 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-331016e7-a79d-4d89-8c92-35d3ec91ad89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:46.103959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-331016e7-a79d-4d89-8c92-35d3ec91ad89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.290610 Sep 09 13:18:46.113512 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 269/519] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:45 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:46.138248 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b025fec4-8d67-4e0f-b44d-f4f97033b262 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:46.139438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b025fec4-8d67-4e0f-b44d-f4f97033b262 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:46.146271 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b025fec4-8d67-4e0f-b44d-f4f97033b262 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:46.147004 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b025fec4-8d67-4e0f-b44d-f4f97033b262 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:46.147734 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b025fec4-8d67-4e0f-b44d-f4f97033b262 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:46.148600 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b025fec4-8d67-4e0f-b44d-f4f97033b262 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:46.149495 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b025fec4-8d67-4e0f-b44d-f4f97033b262 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:46.150077 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b025fec4-8d67-4e0f-b44d-f4f97033b262 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:46.291284 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b025fec4-8d67-4e0f-b44d-f4f97033b262 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:46.300278 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b025fec4-8d67-4e0f-b44d-f4f97033b262 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:46.301765 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b025fec4-8d67-4e0f-b44d-f4f97033b262 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:46.302924 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b025fec4-8d67-4e0f-b44d-f4f97033b262 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1744 microversion: 2.20 time: 0.168667 Sep 09 13:18:46.303663 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 251/520] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:46 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:46.688403 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-98da356a-b90d-4849-8ab6-730984ff1ce4 req-d564444a-e780-4f64-8a0c-bcec369d248c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f961e5a-6c12-48b6-ae52-e61b993275b3", "name": "network-vif-plugged", "status": "completed", "tag": "b38055a2-318f-4ddd-8392-48b0e32eee23"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:46.707335 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-98da356a-b90d-4849-8ab6-730984ff1ce4 req-d564444a-e780-4f64-8a0c-bcec369d248c service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:46.711773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-98da356a-b90d-4849-8ab6-730984ff1ce4 req-d564444a-e780-4f64-8a0c-bcec369d248c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:46.712389 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-98da356a-b90d-4849-8ab6-730984ff1ce4 req-d564444a-e780-4f64-8a0c-bcec369d248c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:46.739656 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-98da356a-b90d-4849-8ab6-730984ff1ce4 req-d564444a-e780-4f64-8a0c-bcec369d248c service nova] Creating event network-vif-plugged:b38055a2-318f-4ddd-8392-48b0e32eee23 for instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 on hv-cinder-83124 Sep 09 13:18:46.748479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-98da356a-b90d-4849-8ab6-730984ff1ce4 req-d564444a-e780-4f64-8a0c-bcec369d248c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063786 Sep 09 13:18:46.749642 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 270/521] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:46.749864 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-11efd23c-97fa-4c56-a5a5-e5904cd69faf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:46.750459 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-11efd23c-97fa-4c56-a5a5-e5904cd69faf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:46.759356 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11efd23c-97fa-4c56-a5a5-e5904cd69faf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:46.759868 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11efd23c-97fa-4c56-a5a5-e5904cd69faf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:46.760311 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11efd23c-97fa-4c56-a5a5-e5904cd69faf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:46.761563 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11efd23c-97fa-4c56-a5a5-e5904cd69faf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:46.762026 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11efd23c-97fa-4c56-a5a5-e5904cd69faf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:46.762451 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11efd23c-97fa-4c56-a5a5-e5904cd69faf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:46.908822 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-11efd23c-97fa-4c56-a5a5-e5904cd69faf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:46.917817 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-11efd23c-97fa-4c56-a5a5-e5904cd69faf tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1663 microversion: 2.1 time: 0.171139 Sep 09 13:18:46.931260 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 252/522] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:46 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1663 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:47.073720 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-940e8996-bbb7-4a1d-afe9-2877a4a47e76 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:47.074664 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-940e8996-bbb7-4a1d-afe9-2877a4a47e76 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:47.080562 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-940e8996-bbb7-4a1d-afe9-2877a4a47e76 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:47.081043 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-940e8996-bbb7-4a1d-afe9-2877a4a47e76 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:47.081471 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-940e8996-bbb7-4a1d-afe9-2877a4a47e76 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:47.082155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-940e8996-bbb7-4a1d-afe9-2877a4a47e76 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:47.082608 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-940e8996-bbb7-4a1d-afe9-2877a4a47e76 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:47.083030 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-940e8996-bbb7-4a1d-afe9-2877a4a47e76 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:47.128201 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a5814c0c-b771-496b-a382-507132d60f89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:47.128808 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a5814c0c-b771-496b-a382-507132d60f89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:47.135387 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5814c0c-b771-496b-a382-507132d60f89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:47.137354 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5814c0c-b771-496b-a382-507132d60f89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:47.137970 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5814c0c-b771-496b-a382-507132d60f89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:47.138842 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5814c0c-b771-496b-a382-507132d60f89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:47.139495 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5814c0c-b771-496b-a382-507132d60f89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:47.139916 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a5814c0c-b771-496b-a382-507132d60f89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:47.152589 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-940e8996-bbb7-4a1d-afe9-2877a4a47e76 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:47.161330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-940e8996-bbb7-4a1d-afe9-2877a4a47e76 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1615 microversion: 2.1 time: 0.093202 Sep 09 13:18:47.171083 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 271/523] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:47 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1615 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:47.305046 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a5814c0c-b771-496b-a382-507132d60f89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:47.321509 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a5814c0c-b771-496b-a382-507132d60f89 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.197066 Sep 09 13:18:47.323404 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 253/524] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:47 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:47.335843 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-00804ca2-eace-4505-88f3-4968cee7701d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:47.337481 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-00804ca2-eace-4505-88f3-4968cee7701d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:47.351329 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00804ca2-eace-4505-88f3-4968cee7701d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:47.352354 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00804ca2-eace-4505-88f3-4968cee7701d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:47.353261 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00804ca2-eace-4505-88f3-4968cee7701d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:47.356195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00804ca2-eace-4505-88f3-4968cee7701d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:47.357228 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00804ca2-eace-4505-88f3-4968cee7701d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:47.358251 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-00804ca2-eace-4505-88f3-4968cee7701d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:47.517924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-00804ca2-eace-4505-88f3-4968cee7701d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:47.527105 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-00804ca2-eace-4505-88f3-4968cee7701d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:47.529007 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-00804ca2-eace-4505-88f3-4968cee7701d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:47.536505 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-00804ca2-eace-4505-88f3-4968cee7701d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1744 microversion: 2.20 time: 0.202573 Sep 09 13:18:47.537193 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 272/525] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:47 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1744 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:47.942509 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-42b736b7-8da4-4b24-8787-61c88cb5c040 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:47.943163 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-42b736b7-8da4-4b24-8787-61c88cb5c040 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:47.950340 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42b736b7-8da4-4b24-8787-61c88cb5c040 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:47.950894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42b736b7-8da4-4b24-8787-61c88cb5c040 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:47.951368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42b736b7-8da4-4b24-8787-61c88cb5c040 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:47.952080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42b736b7-8da4-4b24-8787-61c88cb5c040 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:47.952540 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42b736b7-8da4-4b24-8787-61c88cb5c040 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:47.952964 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42b736b7-8da4-4b24-8787-61c88cb5c040 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:48.092119 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-42b736b7-8da4-4b24-8787-61c88cb5c040 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:48.100541 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-42b736b7-8da4-4b24-8787-61c88cb5c040 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1663 microversion: 2.1 time: 0.161801 Sep 09 13:18:48.115766 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 254/526] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:47 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1663 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:48.190166 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f206d1e-b7b6-4c73-8ddd-e51b1dea9524 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:48.190773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9f206d1e-b7b6-4c73-8ddd-e51b1dea9524 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:48.197261 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f206d1e-b7b6-4c73-8ddd-e51b1dea9524 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:48.197676 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f206d1e-b7b6-4c73-8ddd-e51b1dea9524 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:48.198605 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f206d1e-b7b6-4c73-8ddd-e51b1dea9524 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:48.199669 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f206d1e-b7b6-4c73-8ddd-e51b1dea9524 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:48.200124 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f206d1e-b7b6-4c73-8ddd-e51b1dea9524 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:48.200542 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f206d1e-b7b6-4c73-8ddd-e51b1dea9524 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:48.268380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f206d1e-b7b6-4c73-8ddd-e51b1dea9524 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:48.277070 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f206d1e-b7b6-4c73-8ddd-e51b1dea9524 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1615 microversion: 2.1 time: 0.089970 Sep 09 13:18:48.278182 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 273/527] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:48 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1615 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:48.370828 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ca3c50b5-937b-45c6-a826-b1ff61fe02ae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:48.371919 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ca3c50b5-937b-45c6-a826-b1ff61fe02ae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:48.378336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ca3c50b5-937b-45c6-a826-b1ff61fe02ae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:48.379070 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ca3c50b5-937b-45c6-a826-b1ff61fe02ae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:48.379860 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ca3c50b5-937b-45c6-a826-b1ff61fe02ae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:48.380578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ca3c50b5-937b-45c6-a826-b1ff61fe02ae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:48.381035 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ca3c50b5-937b-45c6-a826-b1ff61fe02ae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:48.381463 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ca3c50b5-937b-45c6-a826-b1ff61fe02ae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:48.563817 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ca3c50b5-937b-45c6-a826-b1ff61fe02ae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:48.566141 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e54a54ec-dc45-49e7-be44-1d3910c1c703 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:48.566995 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e54a54ec-dc45-49e7-be44-1d3910c1c703 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:48.572453 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ca3c50b5-937b-45c6-a826-b1ff61fe02ae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.206247 Sep 09 13:18:48.574897 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e54a54ec-dc45-49e7-be44-1d3910c1c703 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:48.575434 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e54a54ec-dc45-49e7-be44-1d3910c1c703 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:48.575869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e54a54ec-dc45-49e7-be44-1d3910c1c703 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:48.576752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e54a54ec-dc45-49e7-be44-1d3910c1c703 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:48.577516 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e54a54ec-dc45-49e7-be44-1d3910c1c703 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:48.578131 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e54a54ec-dc45-49e7-be44-1d3910c1c703 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:48.587871 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 255/528] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:48 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:48.768364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e54a54ec-dc45-49e7-be44-1d3910c1c703 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:48.778284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e54a54ec-dc45-49e7-be44-1d3910c1c703 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:48.780046 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e54a54ec-dc45-49e7-be44-1d3910c1c703 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:48.781237 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e54a54ec-dc45-49e7-be44-1d3910c1c703 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1744 microversion: 2.20 time: 0.220241 Sep 09 13:18:48.781795 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 274/529] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:48 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:49.126032 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1d2f3f08-f239-45df-8943-7b521345be53 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:49.126879 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1d2f3f08-f239-45df-8943-7b521345be53 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:49.133705 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d2f3f08-f239-45df-8943-7b521345be53 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:49.134235 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d2f3f08-f239-45df-8943-7b521345be53 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:49.134670 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d2f3f08-f239-45df-8943-7b521345be53 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:49.135466 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d2f3f08-f239-45df-8943-7b521345be53 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:49.136111 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d2f3f08-f239-45df-8943-7b521345be53 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:49.136626 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d2f3f08-f239-45df-8943-7b521345be53 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:49.281525 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1d2f3f08-f239-45df-8943-7b521345be53 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:49.289161 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1d2f3f08-f239-45df-8943-7b521345be53 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1663 microversion: 2.1 time: 0.167394 Sep 09 13:18:49.289733 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 256/530] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:49 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:49.300528 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eae296a8-ae3f-4ccc-895f-437525ee3156 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:49.301259 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eae296a8-ae3f-4ccc-895f-437525ee3156 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:49.307780 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eae296a8-ae3f-4ccc-895f-437525ee3156 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:49.308260 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eae296a8-ae3f-4ccc-895f-437525ee3156 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:49.308691 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eae296a8-ae3f-4ccc-895f-437525ee3156 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:49.309407 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eae296a8-ae3f-4ccc-895f-437525ee3156 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:49.309868 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eae296a8-ae3f-4ccc-895f-437525ee3156 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:49.310290 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eae296a8-ae3f-4ccc-895f-437525ee3156 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:49.376567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-eae296a8-ae3f-4ccc-895f-437525ee3156 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:49.384201 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eae296a8-ae3f-4ccc-895f-437525ee3156 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1615 microversion: 2.1 time: 0.087439 Sep 09 13:18:49.384755 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 275/531] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:49 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:49.562376 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1654513991", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1196201159", "security_groups": [{"name": "tempest-secgroup-smoke-923087579"}], "networks": [{"uuid": "d1a79e55-fae9-4f42-a5ee-aeb2b69649f9"}], "block_device_mapping_v2": [{"uuid": "acde9ac2-f16f-4968-b95a-7cdca6c1e018", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:49.601066 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ae22f3a0-f6ad-4f55-9eda-7896aceec132 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:49.601854 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ae22f3a0-f6ad-4f55-9eda-7896aceec132 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:49.610177 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae22f3a0-f6ad-4f55-9eda-7896aceec132 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:49.610500 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae22f3a0-f6ad-4f55-9eda-7896aceec132 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:49.610864 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae22f3a0-f6ad-4f55-9eda-7896aceec132 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:49.611767 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae22f3a0-f6ad-4f55-9eda-7896aceec132 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:49.612216 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae22f3a0-f6ad-4f55-9eda-7896aceec132 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:49.612635 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ae22f3a0-f6ad-4f55-9eda-7896aceec132 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:49.752388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] validate_networks() for [('d1a79e55-fae9-4f42-a5ee-aeb2b69649f9', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:18:49.798382 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ae22f3a0-f6ad-4f55-9eda-7896aceec132 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:49.816996 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ae22f3a0-f6ad-4f55-9eda-7896aceec132 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.220129 Sep 09 13:18:49.820751 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 276/532] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:49 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:49.828722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8c096e61-b5ea-4a74-af51-1197e17cf98b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:49.829359 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8c096e61-b5ea-4a74-af51-1197e17cf98b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:49.856366 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c096e61-b5ea-4a74-af51-1197e17cf98b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:49.857009 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c096e61-b5ea-4a74-af51-1197e17cf98b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:49.857580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c096e61-b5ea-4a74-af51-1197e17cf98b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:49.858389 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c096e61-b5ea-4a74-af51-1197e17cf98b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:49.858892 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c096e61-b5ea-4a74-af51-1197e17cf98b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:49.859433 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8c096e61-b5ea-4a74-af51-1197e17cf98b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:50.036945 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8c096e61-b5ea-4a74-af51-1197e17cf98b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:50.045271 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8c096e61-b5ea-4a74-af51-1197e17cf98b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:50.046995 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8c096e61-b5ea-4a74-af51-1197e17cf98b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:50.048276 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8c096e61-b5ea-4a74-af51-1197e17cf98b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1744 microversion: 2.20 time: 0.226555 Sep 09 13:18:50.057873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 277/533] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:49 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1744 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:50.254217 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:18:50.254700 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:18:50.255141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:18:50.255558 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:18:50.255976 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:18:50.266205 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:50.266688 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:50.267160 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:50.267896 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:50.268561 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:50.269042 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:50.287823 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Getting quotas for project 4cc8da7b799a4bf49ce080e37a36c1d0. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:18:50.293014 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Getting quotas for user 3edc8b9046ac4112a838a9c3b39aecf0 and project 4cc8da7b799a4bf49ce080e37a36c1d0. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:18:50.314975 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-48f1363a-3984-43b9-84e6-9b68715b3e54 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:50.315694 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-48f1363a-3984-43b9-84e6-9b68715b3e54 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:50.324692 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48f1363a-3984-43b9-84e6-9b68715b3e54 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:50.325273 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48f1363a-3984-43b9-84e6-9b68715b3e54 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:50.325780 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48f1363a-3984-43b9-84e6-9b68715b3e54 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:50.326553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48f1363a-3984-43b9-84e6-9b68715b3e54 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:50.327099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48f1363a-3984-43b9-84e6-9b68715b3e54 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:50.327613 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-48f1363a-3984-43b9-84e6-9b68715b3e54 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:50.353257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:18:50.360685 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='acde9ac2-f16f-4968-b95a-7cdca6c1e018',volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:18:50.485140 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-48f1363a-3984-43b9-84e6-9b68715b3e54 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:50.493255 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-48f1363a-3984-43b9-84e6-9b68715b3e54 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1663 microversion: 2.1 time: 0.182497 Sep 09 13:18:50.494071 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 278/534] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:50 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1663 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:50.504053 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a07bf4e8-0690-4ca1-8871-05b1047e23eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:50.504906 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a07bf4e8-0690-4ca1-8871-05b1047e23eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:50.511555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07bf4e8-0690-4ca1-8871-05b1047e23eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:50.512057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07bf4e8-0690-4ca1-8871-05b1047e23eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:50.512604 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07bf4e8-0690-4ca1-8871-05b1047e23eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:50.513299 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07bf4e8-0690-4ca1-8871-05b1047e23eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:50.513778 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07bf4e8-0690-4ca1-8871-05b1047e23eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:50.514141 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a07bf4e8-0690-4ca1-8871-05b1047e23eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:50.531222 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3619b86e-e5c9-484b-9a02-0235dc951a25 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.975652 Sep 09 13:18:50.531870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 257/535] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:18:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:18:50.543499 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-acb541ec-53da-4bf0-9ad4-6cbd56acc7c9 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:50.544119 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-acb541ec-53da-4bf0-9ad4-6cbd56acc7c9 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:50.584358 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a07bf4e8-0690-4ca1-8871-05b1047e23eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:50.594887 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a07bf4e8-0690-4ca1-8871-05b1047e23eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1615 microversion: 2.1 time: 0.099600 Sep 09 13:18:50.599470 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 279/536] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:50 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1615 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:50.637301 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-acb541ec-53da-4bf0-9ad4-6cbd56acc7c9 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:50.644670 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-acb541ec-53da-4bf0-9ad4-6cbd56acc7c9 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1089 microversion: 2.1 time: 0.105697 Sep 09 13:18:50.645259 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 258/537] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:50 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1089 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:50.759930 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-61806cdf-d3b9-45f8-a891-072e32017c62 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:50.760367 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-61806cdf-d3b9-45f8-a891-072e32017c62 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:50.766828 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61806cdf-d3b9-45f8-a891-072e32017c62 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:50.767446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61806cdf-d3b9-45f8-a891-072e32017c62 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:50.767884 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61806cdf-d3b9-45f8-a891-072e32017c62 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:50.768574 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61806cdf-d3b9-45f8-a891-072e32017c62 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:50.769030 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61806cdf-d3b9-45f8-a891-072e32017c62 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:50.769452 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-61806cdf-d3b9-45f8-a891-072e32017c62 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:50.846281 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b5ebcea3-508d-4ec2-a3cd-c430d98e5ee8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:50.846999 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b5ebcea3-508d-4ec2-a3cd-c430d98e5ee8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:50.853322 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5ebcea3-508d-4ec2-a3cd-c430d98e5ee8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:50.853812 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5ebcea3-508d-4ec2-a3cd-c430d98e5ee8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:50.854830 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5ebcea3-508d-4ec2-a3cd-c430d98e5ee8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:50.856059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5ebcea3-508d-4ec2-a3cd-c430d98e5ee8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:50.856520 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5ebcea3-508d-4ec2-a3cd-c430d98e5ee8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:50.856953 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b5ebcea3-508d-4ec2-a3cd-c430d98e5ee8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:50.865414 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-61806cdf-d3b9-45f8-a891-072e32017c62 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lazy-loading 'services' on Instance uuid 6949716a-80fb-47e7-84fc-4c4f5b656436 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:18:50.972023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-61806cdf-d3b9-45f8-a891-072e32017c62 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436/os-volume_attachments/9aad19ef-b91e-4cef-beb9-85e941901338" status: 202 len: 0 microversion: 2.1 time: 0.216029 Sep 09 13:18:50.972949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 280/538] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 13:18:50 2022] DELETE /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436/os-volume_attachments/9aad19ef-b91e-4cef-beb9-85e941901338 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:18:51.012283 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b5ebcea3-508d-4ec2-a3cd-c430d98e5ee8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:51.020510 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b5ebcea3-508d-4ec2-a3cd-c430d98e5ee8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.180298 Sep 09 13:18:51.021086 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 259/539] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:50 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:51.076322 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ac6e5531-316f-4989-9504-3c52fd2824ad tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:51.077083 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ac6e5531-316f-4989-9504-3c52fd2824ad tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:51.084194 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac6e5531-316f-4989-9504-3c52fd2824ad tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:51.084975 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac6e5531-316f-4989-9504-3c52fd2824ad tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:51.085739 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac6e5531-316f-4989-9504-3c52fd2824ad tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:51.086700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac6e5531-316f-4989-9504-3c52fd2824ad tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:51.087183 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac6e5531-316f-4989-9504-3c52fd2824ad tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:51.087626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ac6e5531-316f-4989-9504-3c52fd2824ad tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:51.291304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ac6e5531-316f-4989-9504-3c52fd2824ad tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:51.299496 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ac6e5531-316f-4989-9504-3c52fd2824ad tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:51.301042 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ac6e5531-316f-4989-9504-3c52fd2824ad tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:51.302311 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ac6e5531-316f-4989-9504-3c52fd2824ad tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1744 microversion: 2.20 time: 0.231547 Sep 09 13:18:51.303037 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 281/540] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:51 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1744 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:51.517654 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5e4dd975-3fde-4e8b-99c7-26b48b40ff9b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:51.518928 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5e4dd975-3fde-4e8b-99c7-26b48b40ff9b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:51.526258 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e4dd975-3fde-4e8b-99c7-26b48b40ff9b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:51.527463 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e4dd975-3fde-4e8b-99c7-26b48b40ff9b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:51.528013 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e4dd975-3fde-4e8b-99c7-26b48b40ff9b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:51.528717 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e4dd975-3fde-4e8b-99c7-26b48b40ff9b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:51.529603 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e4dd975-3fde-4e8b-99c7-26b48b40ff9b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:51.530396 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5e4dd975-3fde-4e8b-99c7-26b48b40ff9b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:51.534960 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:51.626733 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cca100e4-773b-4ba8-bd41-23c5e0fdb2d3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:51.627388 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cca100e4-773b-4ba8-bd41-23c5e0fdb2d3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:51.637147 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca100e4-773b-4ba8-bd41-23c5e0fdb2d3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:51.638876 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca100e4-773b-4ba8-bd41-23c5e0fdb2d3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:51.640364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca100e4-773b-4ba8-bd41-23c5e0fdb2d3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:51.644229 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca100e4-773b-4ba8-bd41-23c5e0fdb2d3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:51.644861 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca100e4-773b-4ba8-bd41-23c5e0fdb2d3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:51.655382 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca100e4-773b-4ba8-bd41-23c5e0fdb2d3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:51.727355 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca100e4-773b-4ba8-bd41-23c5e0fdb2d3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:51.727979 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca100e4-773b-4ba8-bd41-23c5e0fdb2d3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:51.728617 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cca100e4-773b-4ba8-bd41-23c5e0fdb2d3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:51.729062 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-cca100e4-773b-4ba8-bd41-23c5e0fdb2d3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lazy-loading 'fault' on Instance uuid 67dfd749-af70-47be-a3de-523bc6cbd77d {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:18:51.804990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cca100e4-773b-4ba8-bd41-23c5e0fdb2d3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:51.815148 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cca100e4-773b-4ba8-bd41-23c5e0fdb2d3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 200 len: 1331 microversion: 2.1 time: 0.195029 Sep 09 13:18:51.817301 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 282/541] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:51 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 1331 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:51.822428 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb38f592-1fe9-43d1-af10-6ff6d33ba534 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:51.824033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eb38f592-1fe9-43d1-af10-6ff6d33ba534 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:51.834380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb38f592-1fe9-43d1-af10-6ff6d33ba534 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:51.835175 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb38f592-1fe9-43d1-af10-6ff6d33ba534 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:51.835388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5e4dd975-3fde-4e8b-99c7-26b48b40ff9b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:51.836074 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb38f592-1fe9-43d1-af10-6ff6d33ba534 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:51.837030 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb38f592-1fe9-43d1-af10-6ff6d33ba534 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:51.837846 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb38f592-1fe9-43d1-af10-6ff6d33ba534 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:51.838492 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb38f592-1fe9-43d1-af10-6ff6d33ba534 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:51.843260 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5e4dd975-3fde-4e8b-99c7-26b48b40ff9b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1663 microversion: 2.1 time: 0.329299 Sep 09 13:18:51.863702 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 260/542] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:51 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1663 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:51.927851 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-eb38f592-1fe9-43d1-af10-6ff6d33ba534 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:51.931906 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:51.951320 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb38f592-1fe9-43d1-af10-6ff6d33ba534 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1131 microversion: 2.1 time: 0.132713 Sep 09 13:18:51.952436 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 283/543] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:51 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1131 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:52.044802 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f7703d76-0ee5-4be9-bf17-46aba8901289 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:52.045497 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f7703d76-0ee5-4be9-bf17-46aba8901289 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:52.052579 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f7703d76-0ee5-4be9-bf17-46aba8901289 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:52.053089 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f7703d76-0ee5-4be9-bf17-46aba8901289 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:52.053627 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f7703d76-0ee5-4be9-bf17-46aba8901289 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:52.054419 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f7703d76-0ee5-4be9-bf17-46aba8901289 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:52.054943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f7703d76-0ee5-4be9-bf17-46aba8901289 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:52.055464 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f7703d76-0ee5-4be9-bf17-46aba8901289 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:52.331156 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-39c80e39-23ee-4a69-9075-b1ff8e946389 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:52.331990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-39c80e39-23ee-4a69-9075-b1ff8e946389 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:52.343100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c80e39-23ee-4a69-9075-b1ff8e946389 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:52.344014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c80e39-23ee-4a69-9075-b1ff8e946389 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:52.344621 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c80e39-23ee-4a69-9075-b1ff8e946389 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:52.345474 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c80e39-23ee-4a69-9075-b1ff8e946389 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:52.346076 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c80e39-23ee-4a69-9075-b1ff8e946389 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:52.346656 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c80e39-23ee-4a69-9075-b1ff8e946389 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:52.430524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f7703d76-0ee5-4be9-bf17-46aba8901289 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:52.446230 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f7703d76-0ee5-4be9-bf17-46aba8901289 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.406099 Sep 09 13:18:52.447805 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 261/544] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:52 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:52.490699 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-32054c53-74b8-4507-bead-954803e8f88b req-25754b45-5c16-4fa0-b72e-843c9bba0a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d", "tag": "19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:52.513156 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-32054c53-74b8-4507-bead-954803e8f88b req-25754b45-5c16-4fa0-b72e-843c9bba0a0c service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:52.519904 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-32054c53-74b8-4507-bead-954803e8f88b req-25754b45-5c16-4fa0-b72e-843c9bba0a0c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:52.520671 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-32054c53-74b8-4507-bead-954803e8f88b req-25754b45-5c16-4fa0-b72e-843c9bba0a0c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:52.559785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-32054c53-74b8-4507-bead-954803e8f88b req-25754b45-5c16-4fa0-b72e-843c9bba0a0c service nova] Creating event network-changed:19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f for instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d on hv-cinder-83124 Sep 09 13:18:52.570956 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-32054c53-74b8-4507-bead-954803e8f88b req-25754b45-5c16-4fa0-b72e-843c9bba0a0c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083319 Sep 09 13:18:52.570956 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 262/545] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:52.606173 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-39c80e39-23ee-4a69-9075-b1ff8e946389 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:52.619722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-39c80e39-23ee-4a69-9075-b1ff8e946389 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:52.622185 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-39c80e39-23ee-4a69-9075-b1ff8e946389 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:52.623366 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-39c80e39-23ee-4a69-9075-b1ff8e946389 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1739 microversion: 2.20 time: 0.297724 Sep 09 13:18:52.626618 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 284/546] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:52 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:18:52.842595 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e4631b3c-1b69-4f33-9e0b-c6f5589f2306 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:52.843310 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e4631b3c-1b69-4f33-9e0b-c6f5589f2306 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:52.849633 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4631b3c-1b69-4f33-9e0b-c6f5589f2306 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:52.850115 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4631b3c-1b69-4f33-9e0b-c6f5589f2306 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:52.850542 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4631b3c-1b69-4f33-9e0b-c6f5589f2306 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:52.851265 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4631b3c-1b69-4f33-9e0b-c6f5589f2306 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:52.851713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4631b3c-1b69-4f33-9e0b-c6f5589f2306 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:52.852131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e4631b3c-1b69-4f33-9e0b-c6f5589f2306 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:52.871785 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b293daeb-a0ac-4447-abdb-5616eb945422 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:52.873529 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b293daeb-a0ac-4447-abdb-5616eb945422 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:52.877187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-e4631b3c-1b69-4f33-9e0b-c6f5589f2306 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] HTTP exception thrown: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e4631b3c-1b69-4f33-9e0b-c6f5589f2306 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Request method failure captured: Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d HTTP/1.1 Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxOEkSw_D0B2DWW3aDp6JHSyeYSFkFADbNPgrw4so5mlP-Ugc06W6Rkqydb-b3AAsVzR7p1RzJdXA1668TSyot_sK8AkXdZkK5Jg9C97nHfO5kDuLQSdUnou_VoOzEQjYwBo46vUgiPeKNiJ0QlKMZ9JN2CFXzSZOPwjJ0bmZDR7mw Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:18:52.878894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:18:52.880364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6b24b42ca93941aa8e70f5fa10303f4d", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:18:52.880364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:18:52.880364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:18:52.880364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:18:52.880364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:18:52.880364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:18:52.880364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:18:52.880364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: dcb88983a8e1439588644b71170d7362 Sep 09 13:18:52.880364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:18:52.880364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:18:52.880364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:18:52.880364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '67dfd749-af70-47be-a3de-523bc6cbd77d'} Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:18:52.881118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:18:52.883254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:18:52.885634 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e4631b3c-1b69-4f33-9e0b-c6f5589f2306 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Returning 404 to user: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:18:52.885805 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b293daeb-a0ac-4447-abdb-5616eb945422 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:52.886293 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e4631b3c-1b69-4f33-9e0b-c6f5589f2306 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 404 len: 111 microversion: 2.1 time: 0.043441 Sep 09 13:18:52.886450 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b293daeb-a0ac-4447-abdb-5616eb945422 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:52.886450 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b293daeb-a0ac-4447-abdb-5616eb945422 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:52.886450 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b293daeb-a0ac-4447-abdb-5616eb945422 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:52.886880 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 263/547] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:52 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:18:52.887027 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b293daeb-a0ac-4447-abdb-5616eb945422 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:52.887027 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b293daeb-a0ac-4447-abdb-5616eb945422 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:52.898149 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c0c49630-ff20-4f64-a067-7817ba56297c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '.version_select at 0x7fd4a1937e50>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:52.962275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c0c49630-ff20-4f64-a067-7817ba56297c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-269040525" status: 202 len: 0 microversion: 2.1 time: 0.067270 Sep 09 13:18:52.968616 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 264/548] 10.222.0.17 () {58 vars in 1218 bytes} [Fri Sep 9 13:18:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-269040525 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:18:52.984708 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2e990151-c617-4bd0-bafd-ad54fde3904f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:52.988077 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2e990151-c617-4bd0-bafd-ad54fde3904f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:53.002790 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e990151-c617-4bd0-bafd-ad54fde3904f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:53.003606 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e990151-c617-4bd0-bafd-ad54fde3904f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:53.004694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e990151-c617-4bd0-bafd-ad54fde3904f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:53.005630 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e990151-c617-4bd0-bafd-ad54fde3904f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:53.008118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e990151-c617-4bd0-bafd-ad54fde3904f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:53.009354 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e990151-c617-4bd0-bafd-ad54fde3904f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:53.109185 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b293daeb-a0ac-4447-abdb-5616eb945422 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:53.115374 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2e990151-c617-4bd0-bafd-ad54fde3904f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:53.125851 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b293daeb-a0ac-4447-abdb-5616eb945422 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1667 microversion: 2.1 time: 0.258591 Sep 09 13:18:53.128751 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 285/549] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:52 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1667 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:53.137699 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2e990151-c617-4bd0-bafd-ad54fde3904f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1187 microversion: 2.1 time: 0.162102 Sep 09 13:18:53.145929 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 265/550] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:52 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1187 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:18:53.470507 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-35ab35c2-bfa5-4b6d-9e96-594e18d260da tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:53.471145 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-35ab35c2-bfa5-4b6d-9e96-594e18d260da tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:53.477436 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35ab35c2-bfa5-4b6d-9e96-594e18d260da tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:53.477916 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35ab35c2-bfa5-4b6d-9e96-594e18d260da tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:53.478343 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35ab35c2-bfa5-4b6d-9e96-594e18d260da tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:53.479104 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35ab35c2-bfa5-4b6d-9e96-594e18d260da tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:53.479745 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35ab35c2-bfa5-4b6d-9e96-594e18d260da tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:53.480355 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-35ab35c2-bfa5-4b6d-9e96-594e18d260da tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:53.652496 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8fceebbc-182b-4c56-a646-85bf6457133b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:53.654525 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8fceebbc-182b-4c56-a646-85bf6457133b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:53.669265 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fceebbc-182b-4c56-a646-85bf6457133b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:53.671647 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fceebbc-182b-4c56-a646-85bf6457133b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:53.672214 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fceebbc-182b-4c56-a646-85bf6457133b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:53.673527 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fceebbc-182b-4c56-a646-85bf6457133b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:53.674166 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fceebbc-182b-4c56-a646-85bf6457133b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:53.675171 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fceebbc-182b-4c56-a646-85bf6457133b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:53.765447 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-35ab35c2-bfa5-4b6d-9e96-594e18d260da tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:53.773227 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-35ab35c2-bfa5-4b6d-9e96-594e18d260da tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.306739 Sep 09 13:18:53.777545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 286/551] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:53 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:53.844373 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8fceebbc-182b-4c56-a646-85bf6457133b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:53.853948 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8fceebbc-182b-4c56-a646-85bf6457133b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:53.856121 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8fceebbc-182b-4c56-a646-85bf6457133b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:53.857389 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8fceebbc-182b-4c56-a646-85bf6457133b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1739 microversion: 2.20 time: 0.210568 Sep 09 13:18:53.858329 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 266/552] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:53 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:54.160835 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a15d3e2e-1ced-40dc-9f3d-18ae3792d1a0 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:54.161450 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a15d3e2e-1ced-40dc-9f3d-18ae3792d1a0 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:54.180800 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a15d3e2e-1ced-40dc-9f3d-18ae3792d1a0 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:54.181783 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a15d3e2e-1ced-40dc-9f3d-18ae3792d1a0 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:54.182993 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a15d3e2e-1ced-40dc-9f3d-18ae3792d1a0 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:54.184661 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a15d3e2e-1ced-40dc-9f3d-18ae3792d1a0 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:54.185284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a15d3e2e-1ced-40dc-9f3d-18ae3792d1a0 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:54.185868 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a15d3e2e-1ced-40dc-9f3d-18ae3792d1a0 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:54.306689 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a15d3e2e-1ced-40dc-9f3d-18ae3792d1a0 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:54.316870 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a15d3e2e-1ced-40dc-9f3d-18ae3792d1a0 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1205 microversion: 2.1 time: 0.159719 Sep 09 13:18:54.319001 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 287/553] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:54 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1205 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:54.335198 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0c24dc33-5474-45cd-9d03-975a4bd44fc4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:54.335930 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0c24dc33-5474-45cd-9d03-975a4bd44fc4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:54.343635 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c24dc33-5474-45cd-9d03-975a4bd44fc4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:54.344130 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c24dc33-5474-45cd-9d03-975a4bd44fc4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:54.344569 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c24dc33-5474-45cd-9d03-975a4bd44fc4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:54.345287 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c24dc33-5474-45cd-9d03-975a4bd44fc4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:54.345744 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c24dc33-5474-45cd-9d03-975a4bd44fc4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:54.346169 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0c24dc33-5474-45cd-9d03-975a4bd44fc4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:54.521022 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-0c24dc33-5474-45cd-9d03-975a4bd44fc4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lazy-loading 'services' on Instance uuid 14183836-171b-4a21-ae32-a214060081e8 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:18:54.694793 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0c24dc33-5474-45cd-9d03-975a4bd44fc4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments/2b2a05b6-dc71-4e8a-be9c-d0cb28c02b64" status: 202 len: 0 microversion: 2.1 time: 0.365148 Sep 09 13:18:54.700430 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 267/554] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 13:18:54 2022] DELETE /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments/2b2a05b6-dc71-4e8a-be9c-d0cb28c02b64 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:18:54.717484 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dfcd522d-e3f6-4c82-bc6e-60fc0f823c79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:54.720288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dfcd522d-e3f6-4c82-bc6e-60fc0f823c79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:54.729979 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfcd522d-e3f6-4c82-bc6e-60fc0f823c79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:54.731639 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfcd522d-e3f6-4c82-bc6e-60fc0f823c79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:54.732765 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfcd522d-e3f6-4c82-bc6e-60fc0f823c79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:54.733638 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfcd522d-e3f6-4c82-bc6e-60fc0f823c79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:54.734187 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfcd522d-e3f6-4c82-bc6e-60fc0f823c79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:54.735085 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dfcd522d-e3f6-4c82-bc6e-60fc0f823c79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:54.768841 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dfcd522d-e3f6-4c82-bc6e-60fc0f823c79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066998 Sep 09 13:18:54.770033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 288/555] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:18:54 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:54.804050 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7f01f6b1-802f-4244-88d5-713cbadeba09 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:54.805300 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-7f01f6b1-802f-4244-88d5-713cbadeba09 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:54.815143 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7f01f6b1-802f-4244-88d5-713cbadeba09 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:54.816005 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7f01f6b1-802f-4244-88d5-713cbadeba09 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:54.817198 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7f01f6b1-802f-4244-88d5-713cbadeba09 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:54.820112 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7f01f6b1-802f-4244-88d5-713cbadeba09 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:54.821443 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7f01f6b1-802f-4244-88d5-713cbadeba09 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:54.822203 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-7f01f6b1-802f-4244-88d5-713cbadeba09 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:54.887563 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ddde2b6c-793c-4104-b599-5e2a83b93bd8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:54.888637 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ddde2b6c-793c-4104-b599-5e2a83b93bd8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:54.898644 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ddde2b6c-793c-4104-b599-5e2a83b93bd8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:54.899439 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ddde2b6c-793c-4104-b599-5e2a83b93bd8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:54.900037 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ddde2b6c-793c-4104-b599-5e2a83b93bd8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:54.900940 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ddde2b6c-793c-4104-b599-5e2a83b93bd8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:54.903240 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ddde2b6c-793c-4104-b599-5e2a83b93bd8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:54.903820 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ddde2b6c-793c-4104-b599-5e2a83b93bd8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:55.050891 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-7f01f6b1-802f-4244-88d5-713cbadeba09 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:55.064594 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7f01f6b1-802f-4244-88d5-713cbadeba09 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.266220 Sep 09 13:18:55.067079 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 268/556] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:54 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:55.092036 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ddde2b6c-793c-4104-b599-5e2a83b93bd8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:55.101944 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ddde2b6c-793c-4104-b599-5e2a83b93bd8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:55.103625 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ddde2b6c-793c-4104-b599-5e2a83b93bd8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:55.105077 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ddde2b6c-793c-4104-b599-5e2a83b93bd8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1739 microversion: 2.20 time: 0.223275 Sep 09 13:18:55.106161 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 289/557] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:54 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:18:55.346769 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f6296ee8-b6c4-4a03-bf2f-679c44a553c5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:55.347417 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f6296ee8-b6c4-4a03-bf2f-679c44a553c5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:55.364878 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6296ee8-b6c4-4a03-bf2f-679c44a553c5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:55.365391 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6296ee8-b6c4-4a03-bf2f-679c44a553c5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:55.366129 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6296ee8-b6c4-4a03-bf2f-679c44a553c5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:55.366882 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6296ee8-b6c4-4a03-bf2f-679c44a553c5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:55.372304 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6296ee8-b6c4-4a03-bf2f-679c44a553c5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:55.372770 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6296ee8-b6c4-4a03-bf2f-679c44a553c5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:55.501864 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f6296ee8-b6c4-4a03-bf2f-679c44a553c5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:55.512257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f6296ee8-b6c4-4a03-bf2f-679c44a553c5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1205 microversion: 2.1 time: 0.170681 Sep 09 13:18:55.519157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 269/558] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:55 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1205 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:55.787486 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-93845300-de24-4357-9a31-571f4ce695ff tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:55.827423 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-93845300-de24-4357-9a31-571f4ce695ff tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:55.836523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93845300-de24-4357-9a31-571f4ce695ff tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:55.837634 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93845300-de24-4357-9a31-571f4ce695ff tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:55.840450 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93845300-de24-4357-9a31-571f4ce695ff tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:55.841645 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93845300-de24-4357-9a31-571f4ce695ff tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:55.842273 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93845300-de24-4357-9a31-571f4ce695ff tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:55.842704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-93845300-de24-4357-9a31-571f4ce695ff tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:55.880134 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-93845300-de24-4357-9a31-571f4ce695ff tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096637 Sep 09 13:18:55.882136 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 290/559] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:18:55 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:56.094660 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-291690ce-4acd-41c8-ae13-6b47ef2e3083 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:56.095822 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-291690ce-4acd-41c8-ae13-6b47ef2e3083 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:56.102931 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-291690ce-4acd-41c8-ae13-6b47ef2e3083 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:56.103450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-291690ce-4acd-41c8-ae13-6b47ef2e3083 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:56.104156 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-291690ce-4acd-41c8-ae13-6b47ef2e3083 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:56.106095 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-291690ce-4acd-41c8-ae13-6b47ef2e3083 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:56.106718 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-291690ce-4acd-41c8-ae13-6b47ef2e3083 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:56.107494 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-291690ce-4acd-41c8-ae13-6b47ef2e3083 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:56.133399 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3081abc7-d097-470d-9562-1090e3fe5c4e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:56.133905 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3081abc7-d097-470d-9562-1090e3fe5c4e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:56.140582 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3081abc7-d097-470d-9562-1090e3fe5c4e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:56.141340 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3081abc7-d097-470d-9562-1090e3fe5c4e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:56.141946 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3081abc7-d097-470d-9562-1090e3fe5c4e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:56.142822 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3081abc7-d097-470d-9562-1090e3fe5c4e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:56.143472 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3081abc7-d097-470d-9562-1090e3fe5c4e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:56.144049 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3081abc7-d097-470d-9562-1090e3fe5c4e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:56.321469 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3081abc7-d097-470d-9562-1090e3fe5c4e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:56.332233 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3081abc7-d097-470d-9562-1090e3fe5c4e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:56.334586 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3081abc7-d097-470d-9562-1090e3fe5c4e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:56.336098 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3081abc7-d097-470d-9562-1090e3fe5c4e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1739 microversion: 2.20 time: 0.206676 Sep 09 13:18:56.337252 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 291/560] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:56 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:18:56.439640 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-291690ce-4acd-41c8-ae13-6b47ef2e3083 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:56.447566 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-291690ce-4acd-41c8-ae13-6b47ef2e3083 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.356675 Sep 09 13:18:56.463369 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 270/561] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:56 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:56.536677 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-802eb533-edd8-4834-b19e-80148e6c048a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:56.537512 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-802eb533-edd8-4834-b19e-80148e6c048a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:56.564944 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-802eb533-edd8-4834-b19e-80148e6c048a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:56.570507 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-802eb533-edd8-4834-b19e-80148e6c048a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:56.571035 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-802eb533-edd8-4834-b19e-80148e6c048a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:56.575987 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-802eb533-edd8-4834-b19e-80148e6c048a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:56.578166 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-802eb533-edd8-4834-b19e-80148e6c048a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:56.581797 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-802eb533-edd8-4834-b19e-80148e6c048a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:56.825983 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-802eb533-edd8-4834-b19e-80148e6c048a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:56.836741 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-802eb533-edd8-4834-b19e-80148e6c048a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1272 microversion: 2.1 time: 0.304435 Sep 09 13:18:56.837849 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 292/562] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:56 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1272 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:56.892813 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8c3e47ed-001f-48f1-b0d5-afe41b1cd54a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:56.895091 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8c3e47ed-001f-48f1-b0d5-afe41b1cd54a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:56.912118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c3e47ed-001f-48f1-b0d5-afe41b1cd54a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:56.912624 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c3e47ed-001f-48f1-b0d5-afe41b1cd54a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:56.913063 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c3e47ed-001f-48f1-b0d5-afe41b1cd54a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:56.913857 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c3e47ed-001f-48f1-b0d5-afe41b1cd54a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:56.914233 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c3e47ed-001f-48f1-b0d5-afe41b1cd54a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:56.914714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c3e47ed-001f-48f1-b0d5-afe41b1cd54a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:56.972202 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8c3e47ed-001f-48f1-b0d5-afe41b1cd54a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083286 Sep 09 13:18:56.972906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 271/563] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:18:56 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:57.206984 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-15906ba1-ef5d-45ab-bbc6-89157600344e req-736500dc-b4fd-4a36-bd46-6b72849a0110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76473280-a8d1-4fed-a202-c9825247c44b", "tag": "48049b9e-9115-47c4-97e1-b44a8a86aef3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:57.219180 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-15906ba1-ef5d-45ab-bbc6-89157600344e req-736500dc-b4fd-4a36-bd46-6b72849a0110 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:57.219922 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-15906ba1-ef5d-45ab-bbc6-89157600344e req-736500dc-b4fd-4a36-bd46-6b72849a0110 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:57.220861 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-15906ba1-ef5d-45ab-bbc6-89157600344e req-736500dc-b4fd-4a36-bd46-6b72849a0110 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:57.234156 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-15906ba1-ef5d-45ab-bbc6-89157600344e req-736500dc-b4fd-4a36-bd46-6b72849a0110 service nova] Creating event network-changed:48049b9e-9115-47c4-97e1-b44a8a86aef3 for instance 76473280-a8d1-4fed-a202-c9825247c44b on hv-cinder-83124 Sep 09 13:18:57.239432 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-15906ba1-ef5d-45ab-bbc6-89157600344e req-736500dc-b4fd-4a36-bd46-6b72849a0110 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036228 Sep 09 13:18:57.240443 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 293/564] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:57.371079 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-22ad5229-543c-4660-bfab-e193e94ba6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:57.373372 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-22ad5229-543c-4660-bfab-e193e94ba6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:57.382642 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22ad5229-543c-4660-bfab-e193e94ba6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:57.383982 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22ad5229-543c-4660-bfab-e193e94ba6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:57.384966 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22ad5229-543c-4660-bfab-e193e94ba6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:57.387537 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22ad5229-543c-4660-bfab-e193e94ba6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:57.388271 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22ad5229-543c-4660-bfab-e193e94ba6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:57.388977 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-22ad5229-543c-4660-bfab-e193e94ba6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:57.475858 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba70eb0d-a79f-49b4-8360-dec29e084d60 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:57.478543 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ba70eb0d-a79f-49b4-8360-dec29e084d60 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:57.488193 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba70eb0d-a79f-49b4-8360-dec29e084d60 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:57.488801 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba70eb0d-a79f-49b4-8360-dec29e084d60 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:57.489340 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba70eb0d-a79f-49b4-8360-dec29e084d60 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:57.490726 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba70eb0d-a79f-49b4-8360-dec29e084d60 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:57.491531 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba70eb0d-a79f-49b4-8360-dec29e084d60 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:57.492366 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ba70eb0d-a79f-49b4-8360-dec29e084d60 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:57.675227 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-22ad5229-543c-4660-bfab-e193e94ba6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:57.690714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-22ad5229-543c-4660-bfab-e193e94ba6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:57.692833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-22ad5229-543c-4660-bfab-e193e94ba6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:57.697126 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-22ad5229-543c-4660-bfab-e193e94ba6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1739 microversion: 2.20 time: 0.334809 Sep 09 13:18:57.699032 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 272/565] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:57 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:57.742701 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ba70eb0d-a79f-49b4-8360-dec29e084d60 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:57.751755 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba70eb0d-a79f-49b4-8360-dec29e084d60 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.281347 Sep 09 13:18:57.763072 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 294/566] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:57 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:57.870867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f35404de-7aa4-4670-8a6e-6fdddc378c27 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:57.872721 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f35404de-7aa4-4670-8a6e-6fdddc378c27 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:57.885592 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f35404de-7aa4-4670-8a6e-6fdddc378c27 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:57.885963 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f35404de-7aa4-4670-8a6e-6fdddc378c27 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:57.886361 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f35404de-7aa4-4670-8a6e-6fdddc378c27 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:57.887141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f35404de-7aa4-4670-8a6e-6fdddc378c27 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:57.887588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f35404de-7aa4-4670-8a6e-6fdddc378c27 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:57.888020 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f35404de-7aa4-4670-8a6e-6fdddc378c27 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:57.987825 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ce659f42-475c-497c-8833-3e8bd98d9531 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:57.991366 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ce659f42-475c-497c-8833-3e8bd98d9531 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:58.001989 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce659f42-475c-497c-8833-3e8bd98d9531 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:58.002399 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce659f42-475c-497c-8833-3e8bd98d9531 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:58.003004 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce659f42-475c-497c-8833-3e8bd98d9531 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:58.006958 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce659f42-475c-497c-8833-3e8bd98d9531 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:58.009903 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce659f42-475c-497c-8833-3e8bd98d9531 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:58.011415 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ce659f42-475c-497c-8833-3e8bd98d9531 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:58.046646 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ce659f42-475c-497c-8833-3e8bd98d9531 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064219 Sep 09 13:18:58.052012 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 295/567] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:18:57 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:58.184288 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f35404de-7aa4-4670-8a6e-6fdddc378c27 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:58.193169 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f35404de-7aa4-4670-8a6e-6fdddc378c27 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1272 microversion: 2.1 time: 0.335534 Sep 09 13:18:58.193995 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 273/568] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:57 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1272 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:58.628360 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d7b54c53-459c-44bd-98b5-71c3389f39ee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:58.630920 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d7b54c53-459c-44bd-98b5-71c3389f39ee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:58.637272 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7b54c53-459c-44bd-98b5-71c3389f39ee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:58.637891 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7b54c53-459c-44bd-98b5-71c3389f39ee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:58.638431 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7b54c53-459c-44bd-98b5-71c3389f39ee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:58.639272 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7b54c53-459c-44bd-98b5-71c3389f39ee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:58.640348 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7b54c53-459c-44bd-98b5-71c3389f39ee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:58.641030 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d7b54c53-459c-44bd-98b5-71c3389f39ee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:58.673372 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-d7b54c53-459c-44bd-98b5-71c3389f39ee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lazy-loading 'flavor' on Instance uuid 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:18:58.726757 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-690ba1a5-17bd-4e09-9da1-b5b4cf455cd7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:58.728153 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-690ba1a5-17bd-4e09-9da1-b5b4cf455cd7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:58.736405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-690ba1a5-17bd-4e09-9da1-b5b4cf455cd7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:58.737819 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-690ba1a5-17bd-4e09-9da1-b5b4cf455cd7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:58.738501 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-690ba1a5-17bd-4e09-9da1-b5b4cf455cd7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:58.739872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-690ba1a5-17bd-4e09-9da1-b5b4cf455cd7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:58.740541 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-690ba1a5-17bd-4e09-9da1-b5b4cf455cd7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:58.741314 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-690ba1a5-17bd-4e09-9da1-b5b4cf455cd7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:58.922179 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d7b54c53-459c-44bd-98b5-71c3389f39ee tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "POST /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/action" status: 200 len: 32 microversion: 2.1 time: 0.295307 Sep 09 13:18:58.929276 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 296/569] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 13:18:58 2022] POST /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/action => generated 32 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:18:58.936955 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b4cbda19-06dd-476a-8925-fc6933a6b803 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:58.937829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b4cbda19-06dd-476a-8925-fc6933a6b803 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:58.944628 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4cbda19-06dd-476a-8925-fc6933a6b803 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:58.945379 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4cbda19-06dd-476a-8925-fc6933a6b803 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:58.945989 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4cbda19-06dd-476a-8925-fc6933a6b803 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:58.947005 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4cbda19-06dd-476a-8925-fc6933a6b803 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:58.947641 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4cbda19-06dd-476a-8925-fc6933a6b803 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:58.949753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b4cbda19-06dd-476a-8925-fc6933a6b803 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:58.951376 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-690ba1a5-17bd-4e09-9da1-b5b4cf455cd7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:58.961332 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-690ba1a5-17bd-4e09-9da1-b5b4cf455cd7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:58.962771 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-690ba1a5-17bd-4e09-9da1-b5b4cf455cd7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:58.964035 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-690ba1a5-17bd-4e09-9da1-b5b4cf455cd7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1739 microversion: 2.20 time: 0.242170 Sep 09 13:18:58.964590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 274/570] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:58 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:18:58.978503 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-35f7545f-381a-4655-94d3-931d9767f64d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:58.995799 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b4cbda19-06dd-476a-8925-fc6933a6b803 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:18:59.000979 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-35f7545f-381a-4655-94d3-931d9767f64d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:59.016628 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35f7545f-381a-4655-94d3-931d9767f64d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:59.019649 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35f7545f-381a-4655-94d3-931d9767f64d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:59.020276 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35f7545f-381a-4655-94d3-931d9767f64d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:59.028457 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35f7545f-381a-4655-94d3-931d9767f64d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:59.029909 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35f7545f-381a-4655-94d3-931d9767f64d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:59.033436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-35f7545f-381a-4655-94d3-931d9767f64d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:59.058840 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:18:59.137901 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b4cbda19-06dd-476a-8925-fc6933a6b803 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 204 len: 0 microversion: 2.1 time: 0.203370 Sep 09 13:18:59.146893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 297/571] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:18:58 2022] DELETE /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:18:59.164488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-247ad2ae-6c59-4634-a305-eda63cdc88c2 req-5cef7ade-8bce-4b36-951d-725a44f12ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d", "name": "network-vif-plugged", "status": "completed", "tag": "19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:18:59.182599 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-247ad2ae-6c59-4634-a305-eda63cdc88c2 req-5cef7ade-8bce-4b36-951d-725a44f12ced service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:59.183192 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-247ad2ae-6c59-4634-a305-eda63cdc88c2 req-5cef7ade-8bce-4b36-951d-725a44f12ced service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:59.184203 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-247ad2ae-6c59-4634-a305-eda63cdc88c2 req-5cef7ade-8bce-4b36-951d-725a44f12ced service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:59.196303 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-247ad2ae-6c59-4634-a305-eda63cdc88c2 req-5cef7ade-8bce-4b36-951d-725a44f12ced service nova] Creating event network-vif-plugged:19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f for instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d on hv-cinder-83124 Sep 09 13:18:59.203639 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-247ad2ae-6c59-4634-a305-eda63cdc88c2 req-5cef7ade-8bce-4b36-951d-725a44f12ced service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051708 Sep 09 13:18:59.204445 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 298/572] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:59.209684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8326c078-c08f-47e7-b6dd-5ded40c9ab23 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:59.210744 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8326c078-c08f-47e7-b6dd-5ded40c9ab23 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:59.218107 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8326c078-c08f-47e7-b6dd-5ded40c9ab23 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:59.218684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8326c078-c08f-47e7-b6dd-5ded40c9ab23 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:59.219222 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8326c078-c08f-47e7-b6dd-5ded40c9ab23 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:59.220179 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8326c078-c08f-47e7-b6dd-5ded40c9ab23 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:59.220732 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8326c078-c08f-47e7-b6dd-5ded40c9ab23 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:59.221235 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8326c078-c08f-47e7-b6dd-5ded40c9ab23 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:59.337108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-35f7545f-381a-4655-94d3-931d9767f64d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:59.349968 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-35f7545f-381a-4655-94d3-931d9767f64d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.374953 Sep 09 13:18:59.363628 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 275/573] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:58 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:59.372912 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8326c078-c08f-47e7-b6dd-5ded40c9ab23 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:59.375478 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c41fa211-0b41-4afd-84a1-bf6457b7581c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:59.378203 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c41fa211-0b41-4afd-84a1-bf6457b7581c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:59.382540 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8326c078-c08f-47e7-b6dd-5ded40c9ab23 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.177056 Sep 09 13:18:59.385166 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c41fa211-0b41-4afd-84a1-bf6457b7581c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:59.385921 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c41fa211-0b41-4afd-84a1-bf6457b7581c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:59.386602 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c41fa211-0b41-4afd-84a1-bf6457b7581c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:59.387600 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c41fa211-0b41-4afd-84a1-bf6457b7581c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:59.388350 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c41fa211-0b41-4afd-84a1-bf6457b7581c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:59.389037 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c41fa211-0b41-4afd-84a1-bf6457b7581c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:59.395872 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 299/574] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:59 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:59.406371 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-09ba58ce-44ec-46fe-a960-68c7f3434e1e tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:59.407274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-09ba58ce-44ec-46fe-a960-68c7f3434e1e tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:59.421247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09ba58ce-44ec-46fe-a960-68c7f3434e1e tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:59.422022 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09ba58ce-44ec-46fe-a960-68c7f3434e1e tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:59.423288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09ba58ce-44ec-46fe-a960-68c7f3434e1e tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:59.424009 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09ba58ce-44ec-46fe-a960-68c7f3434e1e tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:59.424467 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09ba58ce-44ec-46fe-a960-68c7f3434e1e tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:59.424903 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-09ba58ce-44ec-46fe-a960-68c7f3434e1e tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:59.438419 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c41fa211-0b41-4afd-84a1-bf6457b7581c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073231 Sep 09 13:18:59.439128 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 276/575] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:18:59 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:18:59.447212 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-eb119677-4925-498f-8256-69786aa25944 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:59.448450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-eb119677-4925-498f-8256-69786aa25944 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:18:59.454628 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb119677-4925-498f-8256-69786aa25944 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:59.455506 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb119677-4925-498f-8256-69786aa25944 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:59.456132 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb119677-4925-498f-8256-69786aa25944 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:59.457190 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb119677-4925-498f-8256-69786aa25944 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:18:59.457807 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb119677-4925-498f-8256-69786aa25944 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:18:59.458389 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb119677-4925-498f-8256-69786aa25944 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:18:59.602851 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-09ba58ce-44ec-46fe-a960-68c7f3434e1e tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:59.624656 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-09ba58ce-44ec-46fe-a960-68c7f3434e1e tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1513 microversion: 2.1 time: 0.227616 Sep 09 13:18:59.625645 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 300/576] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:59 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:59.663535 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-eb119677-4925-498f-8256-69786aa25944 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:18:59.672657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-eb119677-4925-498f-8256-69786aa25944 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1272 microversion: 2.1 time: 0.232251 Sep 09 13:18:59.673248 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 277/577] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:18:59 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:18:59.993695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f3f4331-d2f9-4fd5-9ef4-1030b4c64c11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:18:59.994291 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f3f4331-d2f9-4fd5-9ef4-1030b4c64c11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:00.006270 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f3f4331-d2f9-4fd5-9ef4-1030b4c64c11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:00.007965 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f3f4331-d2f9-4fd5-9ef4-1030b4c64c11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:00.008565 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f3f4331-d2f9-4fd5-9ef4-1030b4c64c11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:00.009432 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f3f4331-d2f9-4fd5-9ef4-1030b4c64c11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:00.010036 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f3f4331-d2f9-4fd5-9ef4-1030b4c64c11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:00.011301 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f3f4331-d2f9-4fd5-9ef4-1030b4c64c11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:00.172481 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f3f4331-d2f9-4fd5-9ef4-1030b4c64c11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:00.181616 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f3f4331-d2f9-4fd5-9ef4-1030b4c64c11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:00.184088 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f3f4331-d2f9-4fd5-9ef4-1030b4c64c11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:00.185350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f3f4331-d2f9-4fd5-9ef4-1030b4c64c11 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1739 microversion: 2.20 time: 0.195834 Sep 09 13:19:00.199760 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 301/578] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:18:59 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:19:00.379393 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-82daa80a-b233-4806-9859-84d10b53ebe8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:00.380838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-82daa80a-b233-4806-9859-84d10b53ebe8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:00.386730 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:00.388707 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-82daa80a-b233-4806-9859-84d10b53ebe8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:00.389422 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-82daa80a-b233-4806-9859-84d10b53ebe8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:00.390047 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-82daa80a-b233-4806-9859-84d10b53ebe8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:00.391042 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-82daa80a-b233-4806-9859-84d10b53ebe8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:00.391674 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-82daa80a-b233-4806-9859-84d10b53ebe8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:00.392393 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-82daa80a-b233-4806-9859-84d10b53ebe8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:00.411588 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4eb8b149-55ea-42a6-99c2-817c54cdc4a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:00.412667 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4eb8b149-55ea-42a6-99c2-817c54cdc4a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:00.414663 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:00.421225 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4eb8b149-55ea-42a6-99c2-817c54cdc4a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:00.422076 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4eb8b149-55ea-42a6-99c2-817c54cdc4a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:00.423113 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4eb8b149-55ea-42a6-99c2-817c54cdc4a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:00.424314 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4eb8b149-55ea-42a6-99c2-817c54cdc4a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:00.424998 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4eb8b149-55ea-42a6-99c2-817c54cdc4a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:00.425646 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4eb8b149-55ea-42a6-99c2-817c54cdc4a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:00.579975 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-82daa80a-b233-4806-9859-84d10b53ebe8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:00.589916 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-82daa80a-b233-4806-9859-84d10b53ebe8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.214432 Sep 09 13:19:00.605164 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 278/579] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:00 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:00.607248 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9ddac53d-6d45-492a-9bdb-103af66a2014 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:00.611069 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9ddac53d-6d45-492a-9bdb-103af66a2014 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:00.623272 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9ddac53d-6d45-492a-9bdb-103af66a2014 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:00.623909 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9ddac53d-6d45-492a-9bdb-103af66a2014 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:00.624697 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9ddac53d-6d45-492a-9bdb-103af66a2014 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:00.625781 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9ddac53d-6d45-492a-9bdb-103af66a2014 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:00.626460 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9ddac53d-6d45-492a-9bdb-103af66a2014 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:00.627095 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9ddac53d-6d45-492a-9bdb-103af66a2014 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:00.635194 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4eb8b149-55ea-42a6-99c2-817c54cdc4a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:00.645446 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=8 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:00.645657 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4eb8b149-55ea-42a6-99c2-817c54cdc4a5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.239614 Sep 09 13:19:00.656352 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 302/580] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:00 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:00.670892 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b5178d55-5676-47f4-a9aa-71b8ee100212 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:00.672050 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b5178d55-5676-47f4-a9aa-71b8ee100212 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:00.676012 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9ddac53d-6d45-492a-9bdb-103af66a2014 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074427 Sep 09 13:19:00.677110 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 279/581] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:19:00 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:00.680529 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5178d55-5676-47f4-a9aa-71b8ee100212 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:00.681834 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5178d55-5676-47f4-a9aa-71b8ee100212 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:00.682753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5178d55-5676-47f4-a9aa-71b8ee100212 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:00.683921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5178d55-5676-47f4-a9aa-71b8ee100212 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:00.684424 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5178d55-5676-47f4-a9aa-71b8ee100212 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:00.684816 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b5178d55-5676-47f4-a9aa-71b8ee100212 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:00.703134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-864d4cbd-e60a-4f30-aa1f-da2e1c5b7787 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:00.704479 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-864d4cbd-e60a-4f30-aa1f-da2e1c5b7787 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:00.709994 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-864d4cbd-e60a-4f30-aa1f-da2e1c5b7787 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:00.710540 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-864d4cbd-e60a-4f30-aa1f-da2e1c5b7787 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:00.710899 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-864d4cbd-e60a-4f30-aa1f-da2e1c5b7787 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:00.711614 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-864d4cbd-e60a-4f30-aa1f-da2e1c5b7787 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:00.712067 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-864d4cbd-e60a-4f30-aa1f-da2e1c5b7787 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:00.712482 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-864d4cbd-e60a-4f30-aa1f-da2e1c5b7787 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:00.873191 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b5178d55-5676-47f4-a9aa-71b8ee100212 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:00.892931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b5178d55-5676-47f4-a9aa-71b8ee100212 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1513 microversion: 2.1 time: 0.225897 Sep 09 13:19:00.894593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-864d4cbd-e60a-4f30-aa1f-da2e1c5b7787 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:00.907078 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 303/582] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:00 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:00.913936 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-864d4cbd-e60a-4f30-aa1f-da2e1c5b7787 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1272 microversion: 2.1 time: 0.220546 Sep 09 13:19:00.915003 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 280/583] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:00 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:01.215426 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8f7edefe-17b1-472c-8ea3-3919957ed7e1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:01.217705 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8f7edefe-17b1-472c-8ea3-3919957ed7e1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:01.227690 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f7edefe-17b1-472c-8ea3-3919957ed7e1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:01.229752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f7edefe-17b1-472c-8ea3-3919957ed7e1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:01.231713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f7edefe-17b1-472c-8ea3-3919957ed7e1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:01.234724 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f7edefe-17b1-472c-8ea3-3919957ed7e1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:01.235486 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f7edefe-17b1-472c-8ea3-3919957ed7e1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:01.236208 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8f7edefe-17b1-472c-8ea3-3919957ed7e1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:01.597521 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f7edefe-17b1-472c-8ea3-3919957ed7e1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:01.619422 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-052b0fab-513e-4a80-882e-4eb22adc3e51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:01.621113 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-052b0fab-513e-4a80-882e-4eb22adc3e51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:01.624378 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f7edefe-17b1-472c-8ea3-3919957ed7e1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:01.626542 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8f7edefe-17b1-472c-8ea3-3919957ed7e1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:01.628094 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8f7edefe-17b1-472c-8ea3-3919957ed7e1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1739 microversion: 2.20 time: 0.419502 Sep 09 13:19:01.629240 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 304/584] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:01 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1739 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:01.631288 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-052b0fab-513e-4a80-882e-4eb22adc3e51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:01.631771 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-052b0fab-513e-4a80-882e-4eb22adc3e51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:01.632206 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-052b0fab-513e-4a80-882e-4eb22adc3e51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:01.632902 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-052b0fab-513e-4a80-882e-4eb22adc3e51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:01.634378 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-052b0fab-513e-4a80-882e-4eb22adc3e51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:01.634969 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-052b0fab-513e-4a80-882e-4eb22adc3e51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:01.673988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4f5a855b-a749-40bb-a1c4-cabdcc01e38c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:01.675122 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4f5a855b-a749-40bb-a1c4-cabdcc01e38c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:01.686175 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f5a855b-a749-40bb-a1c4-cabdcc01e38c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:01.687173 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f5a855b-a749-40bb-a1c4-cabdcc01e38c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:01.687738 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f5a855b-a749-40bb-a1c4-cabdcc01e38c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:01.690330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f5a855b-a749-40bb-a1c4-cabdcc01e38c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:01.690911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f5a855b-a749-40bb-a1c4-cabdcc01e38c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:01.691691 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4f5a855b-a749-40bb-a1c4-cabdcc01e38c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:01.835848 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-052b0fab-513e-4a80-882e-4eb22adc3e51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:01.849010 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-052b0fab-513e-4a80-882e-4eb22adc3e51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.233462 Sep 09 13:19:01.849490 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 281/585] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:01 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:01.859492 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0955b1d2-931e-4eaa-bb97-39bae0ee13dc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:01.859492 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0955b1d2-931e-4eaa-bb97-39bae0ee13dc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:01.867023 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0955b1d2-931e-4eaa-bb97-39bae0ee13dc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:01.867023 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0955b1d2-931e-4eaa-bb97-39bae0ee13dc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:01.867023 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0955b1d2-931e-4eaa-bb97-39bae0ee13dc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:01.867023 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0955b1d2-931e-4eaa-bb97-39bae0ee13dc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:01.867497 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0955b1d2-931e-4eaa-bb97-39bae0ee13dc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:01.867497 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0955b1d2-931e-4eaa-bb97-39bae0ee13dc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:01.911943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0955b1d2-931e-4eaa-bb97-39bae0ee13dc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060599 Sep 09 13:19:01.912192 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 282/586] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:19:01 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:01.924699 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-656ffd31-75ad-47b1-bd0d-a7cd3d81021d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:01.924699 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-656ffd31-75ad-47b1-bd0d-a7cd3d81021d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:01.931014 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-656ffd31-75ad-47b1-bd0d-a7cd3d81021d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:01.931533 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-656ffd31-75ad-47b1-bd0d-a7cd3d81021d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:01.931972 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-656ffd31-75ad-47b1-bd0d-a7cd3d81021d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:01.933039 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-656ffd31-75ad-47b1-bd0d-a7cd3d81021d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:01.933863 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-656ffd31-75ad-47b1-bd0d-a7cd3d81021d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:01.934137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-656ffd31-75ad-47b1-bd0d-a7cd3d81021d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:01.939750 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4f5a855b-a749-40bb-a1c4-cabdcc01e38c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:01.952785 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4f5a855b-a749-40bb-a1c4-cabdcc01e38c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.281606 Sep 09 13:19:01.952785 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 305/587] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:01 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:01.957840 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14dabcfb-eff3-4c94-8cf6-a2765552af13 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:01.960854 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-14dabcfb-eff3-4c94-8cf6-a2765552af13 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:01.975769 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14dabcfb-eff3-4c94-8cf6-a2765552af13 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:01.982490 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14dabcfb-eff3-4c94-8cf6-a2765552af13 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:01.983358 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14dabcfb-eff3-4c94-8cf6-a2765552af13 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:01.984303 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14dabcfb-eff3-4c94-8cf6-a2765552af13 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:01.985039 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14dabcfb-eff3-4c94-8cf6-a2765552af13 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:01.985889 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14dabcfb-eff3-4c94-8cf6-a2765552af13 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:02.200064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-14dabcfb-eff3-4c94-8cf6-a2765552af13 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:02.210761 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14dabcfb-eff3-4c94-8cf6-a2765552af13 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.256412 Sep 09 13:19:02.212083 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 306/588] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:01 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:02.271286 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-656ffd31-75ad-47b1-bd0d-a7cd3d81021d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:02.282792 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-656ffd31-75ad-47b1-bd0d-a7cd3d81021d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1513 microversion: 2.1 time: 0.362964 Sep 09 13:19:02.300927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 283/589] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:01 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1513 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:02.470629 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-a02b5af7-3d80-410d-9a2b-685e9ee63f00 req-d30ec2af-bcda-4b82-aa0f-a24332f3986d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6949716a-80fb-47e7-84fc-4c4f5b656436", "name": "network-vif-deleted", "tag": "b5cc5bef-ccd1-4987-9ede-7c59c7746d20"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:02.482399 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a02b5af7-3d80-410d-9a2b-685e9ee63f00 req-d30ec2af-bcda-4b82-aa0f-a24332f3986d service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:02.482835 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a02b5af7-3d80-410d-9a2b-685e9ee63f00 req-d30ec2af-bcda-4b82-aa0f-a24332f3986d service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:02.483007 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-a02b5af7-3d80-410d-9a2b-685e9ee63f00 req-d30ec2af-bcda-4b82-aa0f-a24332f3986d service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:02.497063 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-a02b5af7-3d80-410d-9a2b-685e9ee63f00 req-d30ec2af-bcda-4b82-aa0f-a24332f3986d service nova] Creating event network-vif-deleted:b5cc5bef-ccd1-4987-9ede-7c59c7746d20 for instance 6949716a-80fb-47e7-84fc-4c4f5b656436 on hv-cinder-83124 Sep 09 13:19:02.503532 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-a02b5af7-3d80-410d-9a2b-685e9ee63f00 req-d30ec2af-bcda-4b82-aa0f-a24332f3986d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037272 Sep 09 13:19:02.504215 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 307/590] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:19:02.665723 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-81788b9a-e059-4829-bca2-e0b5e6afc1be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:02.667819 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-81788b9a-e059-4829-bca2-e0b5e6afc1be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:02.674379 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81788b9a-e059-4829-bca2-e0b5e6afc1be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:02.674954 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81788b9a-e059-4829-bca2-e0b5e6afc1be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:02.675475 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81788b9a-e059-4829-bca2-e0b5e6afc1be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:02.676329 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81788b9a-e059-4829-bca2-e0b5e6afc1be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:02.676857 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81788b9a-e059-4829-bca2-e0b5e6afc1be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:02.678114 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-81788b9a-e059-4829-bca2-e0b5e6afc1be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:02.883851 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-77bd6118-64ab-402e-b7c0-1fe9b8fddb03 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:02.885518 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-77bd6118-64ab-402e-b7c0-1fe9b8fddb03 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:02.894133 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77bd6118-64ab-402e-b7c0-1fe9b8fddb03 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:02.894684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77bd6118-64ab-402e-b7c0-1fe9b8fddb03 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:02.895284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77bd6118-64ab-402e-b7c0-1fe9b8fddb03 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:02.895445 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-81788b9a-e059-4829-bca2-e0b5e6afc1be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:02.896108 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77bd6118-64ab-402e-b7c0-1fe9b8fddb03 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:02.896625 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77bd6118-64ab-402e-b7c0-1fe9b8fddb03 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:02.897725 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77bd6118-64ab-402e-b7c0-1fe9b8fddb03 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:02.904989 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-81788b9a-e059-4829-bca2-e0b5e6afc1be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:02.906415 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-81788b9a-e059-4829-bca2-e0b5e6afc1be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:02.915967 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-81788b9a-e059-4829-bca2-e0b5e6afc1be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1739 microversion: 2.20 time: 0.253752 Sep 09 13:19:02.936935 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 284/591] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:02 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:02.941015 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f4f1b2d5-5e29-4a4d-9fab-f464b887d0d7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:02.945451 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f4f1b2d5-5e29-4a4d-9fab-f464b887d0d7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:02.957918 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4f1b2d5-5e29-4a4d-9fab-f464b887d0d7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:02.958413 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4f1b2d5-5e29-4a4d-9fab-f464b887d0d7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:02.958846 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4f1b2d5-5e29-4a4d-9fab-f464b887d0d7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:02.959727 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4f1b2d5-5e29-4a4d-9fab-f464b887d0d7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:02.960184 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4f1b2d5-5e29-4a4d-9fab-f464b887d0d7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:02.960788 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4f1b2d5-5e29-4a4d-9fab-f464b887d0d7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:03.003165 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f4f1b2d5-5e29-4a4d-9fab-f464b887d0d7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066471 Sep 09 13:19:03.009513 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 285/592] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:19:02 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 13:19:03.014683 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-05715fd4-2b42-44ab-a4c9-bcbe7a83c9e6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:03.015333 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-05715fd4-2b42-44ab-a4c9-bcbe7a83c9e6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:03.021905 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05715fd4-2b42-44ab-a4c9-bcbe7a83c9e6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:03.022474 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05715fd4-2b42-44ab-a4c9-bcbe7a83c9e6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:03.023092 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05715fd4-2b42-44ab-a4c9-bcbe7a83c9e6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:03.023802 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05715fd4-2b42-44ab-a4c9-bcbe7a83c9e6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:03.024263 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05715fd4-2b42-44ab-a4c9-bcbe7a83c9e6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:03.024690 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05715fd4-2b42-44ab-a4c9-bcbe7a83c9e6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:03.103730 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-77bd6118-64ab-402e-b7c0-1fe9b8fddb03 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:03.115038 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-77bd6118-64ab-402e-b7c0-1fe9b8fddb03 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1358 microversion: 2.1 time: 0.243187 Sep 09 13:19:03.115965 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 308/593] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:02 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:03.121397 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7f0bc407-82d2-4c56-a942-cd84fc24b116 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:03.121902 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7f0bc407-82d2-4c56-a942-cd84fc24b116 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:03.128455 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f0bc407-82d2-4c56-a942-cd84fc24b116 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:03.128957 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f0bc407-82d2-4c56-a942-cd84fc24b116 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:03.129523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f0bc407-82d2-4c56-a942-cd84fc24b116 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:03.130113 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f0bc407-82d2-4c56-a942-cd84fc24b116 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:03.130570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f0bc407-82d2-4c56-a942-cd84fc24b116 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:03.130996 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7f0bc407-82d2-4c56-a942-cd84fc24b116 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:03.161508 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7f0bc407-82d2-4c56-a942-cd84fc24b116 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:19:03.225970 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-05715fd4-2b42-44ab-a4c9-bcbe7a83c9e6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:03.255111 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-05715fd4-2b42-44ab-a4c9-bcbe7a83c9e6 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.243659 Sep 09 13:19:03.270008 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 286/594] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:03 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:03.275416 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f6c5eafe-84e1-44e4-8740-5117cec60300 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:03.276602 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f6c5eafe-84e1-44e4-8740-5117cec60300 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:03.286541 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6c5eafe-84e1-44e4-8740-5117cec60300 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:03.287252 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6c5eafe-84e1-44e4-8740-5117cec60300 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:03.287692 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6c5eafe-84e1-44e4-8740-5117cec60300 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:03.288894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6c5eafe-84e1-44e4-8740-5117cec60300 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:03.289352 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6c5eafe-84e1-44e4-8740-5117cec60300 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:03.289775 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6c5eafe-84e1-44e4-8740-5117cec60300 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:03.295099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:03.306662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7f0bc407-82d2-4c56-a942-cd84fc24b116 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 204 len: 0 microversion: 2.1 time: 0.189305 Sep 09 13:19:03.307841 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 309/595] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:19:03 2022] DELETE /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:19:03.314022 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fa635bb7-a89e-427a-b9c9-fa60668c0feb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:03.314842 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fa635bb7-a89e-427a-b9c9-fa60668c0feb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:03.320764 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa635bb7-a89e-427a-b9c9-fa60668c0feb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:03.321456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa635bb7-a89e-427a-b9c9-fa60668c0feb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:03.321883 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa635bb7-a89e-427a-b9c9-fa60668c0feb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:03.322572 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa635bb7-a89e-427a-b9c9-fa60668c0feb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:03.323023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa635bb7-a89e-427a-b9c9-fa60668c0feb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:03.323811 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa635bb7-a89e-427a-b9c9-fa60668c0feb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:03.390129 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa635bb7-a89e-427a-b9c9-fa60668c0feb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:03.390960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa635bb7-a89e-427a-b9c9-fa60668c0feb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:03.391463 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa635bb7-a89e-427a-b9c9-fa60668c0feb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:03.391982 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-fa635bb7-a89e-427a-b9c9-fa60668c0feb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lazy-loading 'fault' on Instance uuid 6949716a-80fb-47e7-84fc-4c4f5b656436 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:19:03.462873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fa635bb7-a89e-427a-b9c9-fa60668c0feb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:03.473179 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fa635bb7-a89e-427a-b9c9-fa60668c0feb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1309 microversion: 2.1 time: 0.163290 Sep 09 13:19:03.473821 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 310/596] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:03 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1309 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:03.479033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5a30e1b0-4f34-4a27-9537-086d4d596a7c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:03.479666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5a30e1b0-4f34-4a27-9537-086d4d596a7c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:03.487270 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a30e1b0-4f34-4a27-9537-086d4d596a7c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:03.487757 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a30e1b0-4f34-4a27-9537-086d4d596a7c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:03.488194 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a30e1b0-4f34-4a27-9537-086d4d596a7c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:03.488894 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a30e1b0-4f34-4a27-9537-086d4d596a7c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:03.489452 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a30e1b0-4f34-4a27-9537-086d4d596a7c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:03.489574 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f6c5eafe-84e1-44e4-8740-5117cec60300 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:03.489847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5a30e1b0-4f34-4a27-9537-086d4d596a7c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:03.508787 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f6c5eafe-84e1-44e4-8740-5117cec60300 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.231061 Sep 09 13:19:03.509744 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 287/597] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:03 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:03.652362 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5a30e1b0-4f34-4a27-9537-086d4d596a7c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:03.664089 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5a30e1b0-4f34-4a27-9537-086d4d596a7c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1681 microversion: 2.1 time: 0.188551 Sep 09 13:19:03.680273 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 311/598] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:03 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:03.956090 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1c12c59d-f4a3-4a83-b9a4-e439ee4315d9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:03.956691 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1c12c59d-f4a3-4a83-b9a4-e439ee4315d9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:03.963981 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1c12c59d-f4a3-4a83-b9a4-e439ee4315d9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:03.964645 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1c12c59d-f4a3-4a83-b9a4-e439ee4315d9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:03.965082 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1c12c59d-f4a3-4a83-b9a4-e439ee4315d9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:03.965769 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1c12c59d-f4a3-4a83-b9a4-e439ee4315d9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:03.966219 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1c12c59d-f4a3-4a83-b9a4-e439ee4315d9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:03.967270 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1c12c59d-f4a3-4a83-b9a4-e439ee4315d9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.107976 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1c12c59d-f4a3-4a83-b9a4-e439ee4315d9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:04.117067 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1c12c59d-f4a3-4a83-b9a4-e439ee4315d9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:04.118798 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1c12c59d-f4a3-4a83-b9a4-e439ee4315d9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:04.120476 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1c12c59d-f4a3-4a83-b9a4-e439ee4315d9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1739 microversion: 2.20 time: 0.168175 Sep 09 13:19:04.121126 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 288/599] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:03 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:04.143074 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-53619975-8909-4076-9db0-4ba10d44d5ca tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:04.143813 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-53619975-8909-4076-9db0-4ba10d44d5ca tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:04.149875 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53619975-8909-4076-9db0-4ba10d44d5ca tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.150429 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53619975-8909-4076-9db0-4ba10d44d5ca tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.150870 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53619975-8909-4076-9db0-4ba10d44d5ca tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.151756 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53619975-8909-4076-9db0-4ba10d44d5ca tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.152246 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53619975-8909-4076-9db0-4ba10d44d5ca tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.152667 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-53619975-8909-4076-9db0-4ba10d44d5ca tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.280438 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-53619975-8909-4076-9db0-4ba10d44d5ca tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:04.285436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6f7be96a-443e-4e7d-8157-e1b0fe519b7a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:04.286050 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6f7be96a-443e-4e7d-8157-e1b0fe519b7a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:04.287879 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:04.288281 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-53619975-8909-4076-9db0-4ba10d44d5ca tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1549 microversion: 2.1 time: 0.149038 Sep 09 13:19:04.289219 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 312/600] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:04 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:04.292772 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6f7be96a-443e-4e7d-8157-e1b0fe519b7a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.293288 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6f7be96a-443e-4e7d-8157-e1b0fe519b7a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.293722 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6f7be96a-443e-4e7d-8157-e1b0fe519b7a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.294413 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6f7be96a-443e-4e7d-8157-e1b0fe519b7a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.294861 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6f7be96a-443e-4e7d-8157-e1b0fe519b7a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.295305 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6f7be96a-443e-4e7d-8157-e1b0fe519b7a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.311727 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9879565b-5f56-4040-87d1-b1da24053d2d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:04.312458 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9879565b-5f56-4040-87d1-b1da24053d2d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:04.318399 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9879565b-5f56-4040-87d1-b1da24053d2d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.318868 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9879565b-5f56-4040-87d1-b1da24053d2d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.319350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9879565b-5f56-4040-87d1-b1da24053d2d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.320047 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9879565b-5f56-4040-87d1-b1da24053d2d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.320502 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9879565b-5f56-4040-87d1-b1da24053d2d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.320932 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9879565b-5f56-4040-87d1-b1da24053d2d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.339813 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:04.435171 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6f7be96a-443e-4e7d-8157-e1b0fe519b7a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:04.443772 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6f7be96a-443e-4e7d-8157-e1b0fe519b7a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.161939 Sep 09 13:19:04.444365 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 289/601] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:04 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:04.498777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8266c6dd-52ed-40c6-8f0d-f71b2ccd3dbe tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:04.499448 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8266c6dd-52ed-40c6-8f0d-f71b2ccd3dbe tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:04.505656 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8266c6dd-52ed-40c6-8f0d-f71b2ccd3dbe tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.506143 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8266c6dd-52ed-40c6-8f0d-f71b2ccd3dbe tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.506583 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8266c6dd-52ed-40c6-8f0d-f71b2ccd3dbe tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.507320 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8266c6dd-52ed-40c6-8f0d-f71b2ccd3dbe tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.507779 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8266c6dd-52ed-40c6-8f0d-f71b2ccd3dbe tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.508206 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8266c6dd-52ed-40c6-8f0d-f71b2ccd3dbe tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.541311 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8266c6dd-52ed-40c6-8f0d-f71b2ccd3dbe tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.542336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8266c6dd-52ed-40c6-8f0d-f71b2ccd3dbe tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.542777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8266c6dd-52ed-40c6-8f0d-f71b2ccd3dbe tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.543269 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-8266c6dd-52ed-40c6-8f0d-f71b2ccd3dbe tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lazy-loading 'fault' on Instance uuid 6949716a-80fb-47e7-84fc-4c4f5b656436 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:19:04.587136 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8266c6dd-52ed-40c6-8f0d-f71b2ccd3dbe tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:04.595424 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8266c6dd-52ed-40c6-8f0d-f71b2ccd3dbe tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1309 microversion: 2.1 time: 0.101050 Sep 09 13:19:04.596258 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 290/602] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:04 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:04.601552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8969ef91-8b97-4b50-ab29-ff5fe240926e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:04.602061 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8969ef91-8b97-4b50-ab29-ff5fe240926e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:04.613141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8969ef91-8b97-4b50-ab29-ff5fe240926e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.613571 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8969ef91-8b97-4b50-ab29-ff5fe240926e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.614015 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8969ef91-8b97-4b50-ab29-ff5fe240926e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.614742 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8969ef91-8b97-4b50-ab29-ff5fe240926e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.615242 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8969ef91-8b97-4b50-ab29-ff5fe240926e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.615671 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8969ef91-8b97-4b50-ab29-ff5fe240926e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.697930 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9879565b-5f56-4040-87d1-b1da24053d2d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:04.706137 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9879565b-5f56-4040-87d1-b1da24053d2d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1549 microversion: 2.1 time: 0.398702 Sep 09 13:19:04.706711 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 313/603] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:04 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1549 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:04.719576 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d75a0b8a-0f76-4f35-9e60-6bf095deed79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:04.720343 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d75a0b8a-0f76-4f35-9e60-6bf095deed79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:04.726468 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d75a0b8a-0f76-4f35-9e60-6bf095deed79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.726953 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d75a0b8a-0f76-4f35-9e60-6bf095deed79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.727428 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d75a0b8a-0f76-4f35-9e60-6bf095deed79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.728124 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d75a0b8a-0f76-4f35-9e60-6bf095deed79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.728578 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d75a0b8a-0f76-4f35-9e60-6bf095deed79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.729531 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d75a0b8a-0f76-4f35-9e60-6bf095deed79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.750980 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8969ef91-8b97-4b50-ab29-ff5fe240926e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:04.758622 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8969ef91-8b97-4b50-ab29-ff5fe240926e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.161238 Sep 09 13:19:04.759208 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 291/604] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:04 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:04.763805 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-eb778ed7-1191-48a5-ba7d-075491a070c2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:04.768699 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-eb778ed7-1191-48a5-ba7d-075491a070c2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:04.769396 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-eb778ed7-1191-48a5-ba7d-075491a070c2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Searching by: {'deleted': False, 'project_id': 'e7c4b6192be646b38d7757960e02feda'} {{(pid=120623) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 09 13:19:04.776571 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb778ed7-1191-48a5-ba7d-075491a070c2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.777113 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb778ed7-1191-48a5-ba7d-075491a070c2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.777570 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb778ed7-1191-48a5-ba7d-075491a070c2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.778303 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb778ed7-1191-48a5-ba7d-075491a070c2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.778761 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb778ed7-1191-48a5-ba7d-075491a070c2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.779220 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb778ed7-1191-48a5-ba7d-075491a070c2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.868075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d75a0b8a-0f76-4f35-9e60-6bf095deed79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:04.877100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d75a0b8a-0f76-4f35-9e60-6bf095deed79 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1681 microversion: 2.1 time: 0.169328 Sep 09 13:19:04.878099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 314/605] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:04 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:04.881131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.multi_cell_list [None req-eb778ed7-1191-48a5-ba7d-075491a070c2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120623) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 09 13:19:04.977265 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-eb778ed7-1191-48a5-ba7d-075491a070c2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.217009 Sep 09 13:19:04.977934 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 292/606] 10.222.0.17 () {58 vars in 1125 bytes} [Fri Sep 9 13:19:04 2022] GET /compute/v2.1/servers => generated 342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:04.990221 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c2281c61-f541-4b08-b66b-d6490724d37a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:04.990838 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c2281c61-f541-4b08-b66b-d6490724d37a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:04.997180 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2281c61-f541-4b08-b66b-d6490724d37a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.997663 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2281c61-f541-4b08-b66b-d6490724d37a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.998097 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2281c61-f541-4b08-b66b-d6490724d37a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:04.998789 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2281c61-f541-4b08-b66b-d6490724d37a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:04.999330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2281c61-f541-4b08-b66b-d6490724d37a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:04.999702 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c2281c61-f541-4b08-b66b-d6490724d37a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:05.131495 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c2281c61-f541-4b08-b66b-d6490724d37a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:05.139299 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c2281c61-f541-4b08-b66b-d6490724d37a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1549 microversion: 2.1 time: 0.152842 Sep 09 13:19:05.143115 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 315/607] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:04 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:05.146284 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-befefa3e-747f-44b5-be9e-66f84e99fa96 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:05.147188 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-befefa3e-747f-44b5-be9e-66f84e99fa96 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:05.154084 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-befefa3e-747f-44b5-be9e-66f84e99fa96 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:05.154689 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-befefa3e-747f-44b5-be9e-66f84e99fa96 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:05.155257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-befefa3e-747f-44b5-be9e-66f84e99fa96 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:05.156038 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-befefa3e-747f-44b5-be9e-66f84e99fa96 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:05.156587 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-befefa3e-747f-44b5-be9e-66f84e99fa96 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:05.157232 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-befefa3e-747f-44b5-be9e-66f84e99fa96 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:05.333339 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-befefa3e-747f-44b5-be9e-66f84e99fa96 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:05.348788 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-befefa3e-747f-44b5-be9e-66f84e99fa96 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:05.350184 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-befefa3e-747f-44b5-be9e-66f84e99fa96 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:05.351989 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-befefa3e-747f-44b5-be9e-66f84e99fa96 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1739 microversion: 2.20 time: 0.209160 Sep 09 13:19:05.352938 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 293/608] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:05 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:05.468282 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5585108b-d703-44a6-b171-239270251797 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:05.469118 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5585108b-d703-44a6-b171-239270251797 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:05.478522 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5585108b-d703-44a6-b171-239270251797 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:05.479079 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5585108b-d703-44a6-b171-239270251797 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:05.479503 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5585108b-d703-44a6-b171-239270251797 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:05.480232 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5585108b-d703-44a6-b171-239270251797 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:05.481944 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5585108b-d703-44a6-b171-239270251797 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:05.482379 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5585108b-d703-44a6-b171-239270251797 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:05.620894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f0ae4a3c-5a7e-4a8b-a271-3d18eef4e4d8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:05.621635 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f0ae4a3c-5a7e-4a8b-a271-3d18eef4e4d8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:05.628632 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f0ae4a3c-5a7e-4a8b-a271-3d18eef4e4d8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:05.629137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f0ae4a3c-5a7e-4a8b-a271-3d18eef4e4d8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:05.629581 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f0ae4a3c-5a7e-4a8b-a271-3d18eef4e4d8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:05.630277 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f0ae4a3c-5a7e-4a8b-a271-3d18eef4e4d8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:05.630730 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f0ae4a3c-5a7e-4a8b-a271-3d18eef4e4d8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:05.631183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f0ae4a3c-5a7e-4a8b-a271-3d18eef4e4d8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:05.654596 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:05.671135 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f0ae4a3c-5a7e-4a8b-a271-3d18eef4e4d8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:05.671618 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f0ae4a3c-5a7e-4a8b-a271-3d18eef4e4d8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:05.672224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f0ae4a3c-5a7e-4a8b-a271-3d18eef4e4d8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:05.672681 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-f0ae4a3c-5a7e-4a8b-a271-3d18eef4e4d8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lazy-loading 'fault' on Instance uuid 6949716a-80fb-47e7-84fc-4c4f5b656436 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:19:05.731687 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f0ae4a3c-5a7e-4a8b-a271-3d18eef4e4d8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:05.735765 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5585108b-d703-44a6-b171-239270251797 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:05.740192 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f0ae4a3c-5a7e-4a8b-a271-3d18eef4e4d8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 200 len: 1309 microversion: 2.1 time: 0.124163 Sep 09 13:19:05.743097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 294/609] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:05 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 1309 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:05.745372 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5585108b-d703-44a6-b171-239270251797 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.281300 Sep 09 13:19:05.746005 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 316/610] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:05 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:05.781389 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e2bf2737-25e4-49c0-8bb7-5425b25fa5c4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:05.781908 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e2bf2737-25e4-49c0-8bb7-5425b25fa5c4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:05.787895 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2bf2737-25e4-49c0-8bb7-5425b25fa5c4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:05.788374 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2bf2737-25e4-49c0-8bb7-5425b25fa5c4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:05.788809 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2bf2737-25e4-49c0-8bb7-5425b25fa5c4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:05.789490 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2bf2737-25e4-49c0-8bb7-5425b25fa5c4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:05.789937 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2bf2737-25e4-49c0-8bb7-5425b25fa5c4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:05.790355 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2bf2737-25e4-49c0-8bb7-5425b25fa5c4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:05.901095 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3fac89dc-d87b-4a2e-a78d-0ef872a08aa1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:05.901997 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3fac89dc-d87b-4a2e-a78d-0ef872a08aa1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:05.908532 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fac89dc-d87b-4a2e-a78d-0ef872a08aa1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:05.909252 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fac89dc-d87b-4a2e-a78d-0ef872a08aa1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:05.909867 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fac89dc-d87b-4a2e-a78d-0ef872a08aa1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:05.910748 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fac89dc-d87b-4a2e-a78d-0ef872a08aa1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:05.911391 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fac89dc-d87b-4a2e-a78d-0ef872a08aa1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:05.911972 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3fac89dc-d87b-4a2e-a78d-0ef872a08aa1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:06.033875 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e2bf2737-25e4-49c0-8bb7-5425b25fa5c4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:06.043679 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e2bf2737-25e4-49c0-8bb7-5425b25fa5c4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.266136 Sep 09 13:19:06.059831 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 295/611] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:05 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:06.153787 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3fac89dc-d87b-4a2e-a78d-0ef872a08aa1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:06.167831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3fac89dc-d87b-4a2e-a78d-0ef872a08aa1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1681 microversion: 2.1 time: 0.270382 Sep 09 13:19:06.179655 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 317/612] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:05 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1681 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:06.377757 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-52c2695b-7dbc-4f1a-8671-93f8739e1e46 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:06.378517 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-52c2695b-7dbc-4f1a-8671-93f8739e1e46 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:06.384597 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-52c2695b-7dbc-4f1a-8671-93f8739e1e46 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:06.385245 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-52c2695b-7dbc-4f1a-8671-93f8739e1e46 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:06.385858 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-52c2695b-7dbc-4f1a-8671-93f8739e1e46 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:06.386573 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-52c2695b-7dbc-4f1a-8671-93f8739e1e46 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:06.387034 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-52c2695b-7dbc-4f1a-8671-93f8739e1e46 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:06.387488 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-52c2695b-7dbc-4f1a-8671-93f8739e1e46 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:06.454394 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-47ffa9d1-adf0-4094-b616-4d3e06efe567 req-77358081-5bb4-48ac-8c35-75864f2c9d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14183836-171b-4a21-ae32-a214060081e8", "name": "network-vif-deleted", "tag": "1b06de6b-62d9-4d8f-a0ad-1a6e7bf1b164"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:06.464779 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-47ffa9d1-adf0-4094-b616-4d3e06efe567 req-77358081-5bb4-48ac-8c35-75864f2c9d6c service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:06.465340 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-47ffa9d1-adf0-4094-b616-4d3e06efe567 req-77358081-5bb4-48ac-8c35-75864f2c9d6c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:06.466017 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-47ffa9d1-adf0-4094-b616-4d3e06efe567 req-77358081-5bb4-48ac-8c35-75864f2c9d6c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:06.477660 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-47ffa9d1-adf0-4094-b616-4d3e06efe567 req-77358081-5bb4-48ac-8c35-75864f2c9d6c service nova] Creating event network-vif-deleted:1b06de6b-62d9-4d8f-a0ad-1a6e7bf1b164 for instance 14183836-171b-4a21-ae32-a214060081e8 on hv-cinder-83124 Sep 09 13:19:06.483914 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-47ffa9d1-adf0-4094-b616-4d3e06efe567 req-77358081-5bb4-48ac-8c35-75864f2c9d6c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034117 Sep 09 13:19:06.484866 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 318/613] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:19:06.544122 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-52c2695b-7dbc-4f1a-8671-93f8739e1e46 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:06.553083 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-52c2695b-7dbc-4f1a-8671-93f8739e1e46 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:06.554967 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-52c2695b-7dbc-4f1a-8671-93f8739e1e46 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:06.556168 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-52c2695b-7dbc-4f1a-8671-93f8739e1e46 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1721 microversion: 2.20 time: 0.182295 Sep 09 13:19:06.557034 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 296/614] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:06 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:06.769458 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d84c8803-131b-415c-b13f-134eb04eaad1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:06.769458 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d84c8803-131b-415c-b13f-134eb04eaad1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: 6949716a-80fb-47e7-84fc-4c4f5b656436] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:06.769980 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-452e1120-0ce8-4e08-a7ac-8d799f9cb2dd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:06.770677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-452e1120-0ce8-4e08-a7ac-8d799f9cb2dd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:06.773631 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d84c8803-131b-415c-b13f-134eb04eaad1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:06.774306 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d84c8803-131b-415c-b13f-134eb04eaad1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:06.774914 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d84c8803-131b-415c-b13f-134eb04eaad1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:06.776707 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d84c8803-131b-415c-b13f-134eb04eaad1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:06.777904 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d84c8803-131b-415c-b13f-134eb04eaad1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:06.778437 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-452e1120-0ce8-4e08-a7ac-8d799f9cb2dd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:06.778850 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d84c8803-131b-415c-b13f-134eb04eaad1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:06.779227 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-452e1120-0ce8-4e08-a7ac-8d799f9cb2dd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:06.779890 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-452e1120-0ce8-4e08-a7ac-8d799f9cb2dd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:06.780704 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-452e1120-0ce8-4e08-a7ac-8d799f9cb2dd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:06.781309 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-452e1120-0ce8-4e08-a7ac-8d799f9cb2dd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:06.781849 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-452e1120-0ce8-4e08-a7ac-8d799f9cb2dd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:06.795618 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-d84c8803-131b-415c-b13f-134eb04eaad1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] HTTP exception thrown: Instance 6949716a-80fb-47e7-84fc-4c4f5b656436 could not be found. Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d84c8803-131b-415c-b13f-134eb04eaad1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Request method failure captured: Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 HTTP/1.1 Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzzw57pFEwmYDQRMBD9AY0_bAnFF5qDADmm-dRNDaAOtnlGBpFAXbxsh4SkXA6xlz0jmmYC7AhIBpERLQgNealRmVsheIvfS_Dvsn6kqxsv2FHCyl1kzQMooncC0ixcWk5nsa0qjJQX2rVfEuX4VyEE2ggZsocdnfz2ZPZU-V1dGV2E Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 345a9eb6369c43a681649f1bb55ce60c Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesSnapshotTestJSON-112423045 Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:19:06.798364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:19:06.800055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/345a9eb6369c43a681649f1bb55ce60c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/345a9eb6369c43a681649f1bb55ce60c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/345a9eb6369c43a681649f1bb55ce60c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_345a9eb6369c43a681649f1bb55ce60c", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:19:06.800055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesSnapshotTestJSON-112423045 Sep 09 13:19:06.800055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 345a9eb6369c43a681649f1bb55ce60c Sep 09 13:19:06.800055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-112423045 Sep 09 13:19:06.800055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesSnapshotTestJSON-112423045-project Sep 09 13:19:06.800055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:19:06.800055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:19:06.800055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: 41ec6426ddf640389083cc61e948d31f Sep 09 13:19:06.800055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesSnapshotTestJSON-112423045-project Sep 09 13:19:06.800055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:19:06.800055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 6949716a-80fb-47e7-84fc-4c4f5b656436 could not be found. Sep 09 13:19:06.800055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '6949716a-80fb-47e7-84fc-4c4f5b656436'} Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6949716a-80fb-47e7-84fc-4c4f5b656436 could not be found. Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:19:06.801014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6949716a-80fb-47e7-84fc-4c4f5b656436 could not be found. Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6949716a-80fb-47e7-84fc-4c4f5b656436 could not be found. Sep 09 13:19:06.802590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:19:06.804030 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d84c8803-131b-415c-b13f-134eb04eaad1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Returning 404 to user: Instance 6949716a-80fb-47e7-84fc-4c4f5b656436 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:19:06.804030 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d84c8803-131b-415c-b13f-134eb04eaad1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436" status: 404 len: 111 microversion: 2.1 time: 0.043719 Sep 09 13:19:06.809382 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 319/615] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:06 2022] GET /compute/v2.1/servers/6949716a-80fb-47e7-84fc-4c4f5b656436 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:19:06.843695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-210e5531-39cd-499d-86be-323fecc1ad5e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66e4b8ac-a09f-47f9-9117-a96be38425fb"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:06.846565 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-210e5531-39cd-499d-86be-323fecc1ad5e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:06.853243 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-210e5531-39cd-499d-86be-323fecc1ad5e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:06.853488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-210e5531-39cd-499d-86be-323fecc1ad5e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:06.853972 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-210e5531-39cd-499d-86be-323fecc1ad5e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:06.854835 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-210e5531-39cd-499d-86be-323fecc1ad5e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:06.855443 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-210e5531-39cd-499d-86be-323fecc1ad5e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:06.855913 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-210e5531-39cd-499d-86be-323fecc1ad5e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:07.026936 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-452e1120-0ce8-4e08-a7ac-8d799f9cb2dd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:07.036938 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-452e1120-0ce8-4e08-a7ac-8d799f9cb2dd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.270957 Sep 09 13:19:07.038438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 297/616] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:06 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:07.065739 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b31adf14-b8ac-4de4-b997-69fd6ade92a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:07.066474 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b31adf14-b8ac-4de4-b997-69fd6ade92a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:07.074101 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b31adf14-b8ac-4de4-b997-69fd6ade92a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:07.074687 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b31adf14-b8ac-4de4-b997-69fd6ade92a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:07.075251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b31adf14-b8ac-4de4-b997-69fd6ade92a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:07.076071 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b31adf14-b8ac-4de4-b997-69fd6ade92a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:07.077854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b31adf14-b8ac-4de4-b997-69fd6ade92a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:07.077854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b31adf14-b8ac-4de4-b997-69fd6ade92a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:07.207795 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b31adf14-b8ac-4de4-b997-69fd6ade92a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:07.216474 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b31adf14-b8ac-4de4-b997-69fd6ade92a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.154556 Sep 09 13:19:07.217055 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 298/617] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:07 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:07.221490 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-dbf29dc9-755c-40a0-a9e1-2d42dbaf21c6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:07.222093 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-dbf29dc9-755c-40a0-a9e1-2d42dbaf21c6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:07.228094 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dbf29dc9-755c-40a0-a9e1-2d42dbaf21c6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:07.228573 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dbf29dc9-755c-40a0-a9e1-2d42dbaf21c6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:07.229067 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dbf29dc9-755c-40a0-a9e1-2d42dbaf21c6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:07.230251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dbf29dc9-755c-40a0-a9e1-2d42dbaf21c6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:07.230703 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dbf29dc9-755c-40a0-a9e1-2d42dbaf21c6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:07.231330 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-dbf29dc9-755c-40a0-a9e1-2d42dbaf21c6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:07.298042 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-dbf29dc9-755c-40a0-a9e1-2d42dbaf21c6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:07.306262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-dbf29dc9-755c-40a0-a9e1-2d42dbaf21c6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1614 microversion: 2.1 time: 0.088233 Sep 09 13:19:07.306898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 299/618] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:07 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:07.581655 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3c830c48-857a-4a86-b017-418d92ca7f28 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:07.582210 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3c830c48-857a-4a86-b017-418d92ca7f28 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:07.589011 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c830c48-857a-4a86-b017-418d92ca7f28 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:07.589712 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c830c48-857a-4a86-b017-418d92ca7f28 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:07.590394 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c830c48-857a-4a86-b017-418d92ca7f28 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:07.591131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c830c48-857a-4a86-b017-418d92ca7f28 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:07.591593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c830c48-857a-4a86-b017-418d92ca7f28 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:07.592022 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3c830c48-857a-4a86-b017-418d92ca7f28 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:07.724789 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3c830c48-857a-4a86-b017-418d92ca7f28 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:07.734282 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3c830c48-857a-4a86-b017-418d92ca7f28 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:07.735790 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3c830c48-857a-4a86-b017-418d92ca7f28 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:07.736951 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3c830c48-857a-4a86-b017-418d92ca7f28 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1721 microversion: 2.20 time: 0.159338 Sep 09 13:19:07.737511 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 300/619] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:07 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:19:08.061494 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-58bcb206-099f-43c9-ad13-1977f98cbca8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:08.062131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-58bcb206-099f-43c9-ad13-1977f98cbca8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:08.068866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58bcb206-099f-43c9-ad13-1977f98cbca8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:08.069371 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58bcb206-099f-43c9-ad13-1977f98cbca8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:08.069832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58bcb206-099f-43c9-ad13-1977f98cbca8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:08.070770 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58bcb206-099f-43c9-ad13-1977f98cbca8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:08.071642 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58bcb206-099f-43c9-ad13-1977f98cbca8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:08.072135 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-58bcb206-099f-43c9-ad13-1977f98cbca8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:08.199474 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-58bcb206-099f-43c9-ad13-1977f98cbca8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:08.207651 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-58bcb206-099f-43c9-ad13-1977f98cbca8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.150707 Sep 09 13:19:08.208219 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 301/620] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:08 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:08.239519 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2ff918f4-7e2e-4f3a-b775-38fb8472c558 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:08.240129 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2ff918f4-7e2e-4f3a-b775-38fb8472c558 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:08.246993 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2ff918f4-7e2e-4f3a-b775-38fb8472c558 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:08.247503 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2ff918f4-7e2e-4f3a-b775-38fb8472c558 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:08.247941 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2ff918f4-7e2e-4f3a-b775-38fb8472c558 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:08.248625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2ff918f4-7e2e-4f3a-b775-38fb8472c558 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:08.249081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2ff918f4-7e2e-4f3a-b775-38fb8472c558 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:08.249506 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2ff918f4-7e2e-4f3a-b775-38fb8472c558 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:08.381429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2ff918f4-7e2e-4f3a-b775-38fb8472c558 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:08.389015 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2ff918f4-7e2e-4f3a-b775-38fb8472c558 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.153113 Sep 09 13:19:08.389581 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 302/621] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:08 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:08.393814 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-455aad32-f1b6-4ffb-926c-cc27886261a0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:08.394406 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-455aad32-f1b6-4ffb-926c-cc27886261a0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:08.399778 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-455aad32-f1b6-4ffb-926c-cc27886261a0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:08.400254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-455aad32-f1b6-4ffb-926c-cc27886261a0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:08.400681 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-455aad32-f1b6-4ffb-926c-cc27886261a0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:08.401465 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-455aad32-f1b6-4ffb-926c-cc27886261a0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:08.401911 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-455aad32-f1b6-4ffb-926c-cc27886261a0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:08.402330 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-455aad32-f1b6-4ffb-926c-cc27886261a0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:08.462223 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-455aad32-f1b6-4ffb-926c-cc27886261a0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:08.469964 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-455aad32-f1b6-4ffb-926c-cc27886261a0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1614 microversion: 2.1 time: 0.079463 Sep 09 13:19:08.470527 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 303/622] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:08 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1614 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:08.764612 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e9422b15-f270-41ad-8b74-66fd45733fc6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:08.765242 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e9422b15-f270-41ad-8b74-66fd45733fc6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:08.771155 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9422b15-f270-41ad-8b74-66fd45733fc6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:08.771636 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9422b15-f270-41ad-8b74-66fd45733fc6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:08.772064 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9422b15-f270-41ad-8b74-66fd45733fc6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:08.772740 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9422b15-f270-41ad-8b74-66fd45733fc6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:08.773185 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9422b15-f270-41ad-8b74-66fd45733fc6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:08.773599 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e9422b15-f270-41ad-8b74-66fd45733fc6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:08.900498 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e9422b15-f270-41ad-8b74-66fd45733fc6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:08.909215 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e9422b15-f270-41ad-8b74-66fd45733fc6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:08.910644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e9422b15-f270-41ad-8b74-66fd45733fc6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:08.911816 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e9422b15-f270-41ad-8b74-66fd45733fc6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1721 microversion: 2.20 time: 0.151453 Sep 09 13:19:08.912374 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 304/623] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:08 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:19:09.230588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4ce6a6e7-88a8-4ee6-8361-0957d54ca6e5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:09.231226 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4ce6a6e7-88a8-4ee6-8361-0957d54ca6e5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:09.237742 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ce6a6e7-88a8-4ee6-8361-0957d54ca6e5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:09.238224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ce6a6e7-88a8-4ee6-8361-0957d54ca6e5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:09.238661 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ce6a6e7-88a8-4ee6-8361-0957d54ca6e5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:09.239384 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ce6a6e7-88a8-4ee6-8361-0957d54ca6e5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:09.239837 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ce6a6e7-88a8-4ee6-8361-0957d54ca6e5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:09.240256 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ce6a6e7-88a8-4ee6-8361-0957d54ca6e5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:09.370233 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4ce6a6e7-88a8-4ee6-8361-0957d54ca6e5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:09.378385 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4ce6a6e7-88a8-4ee6-8361-0957d54ca6e5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.151606 Sep 09 13:19:09.378951 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 305/624] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:09 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:09.410724 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-62a1a9f6-ff95-4b7e-ba05-fa2c3011c4d2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:09.411356 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-62a1a9f6-ff95-4b7e-ba05-fa2c3011c4d2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:09.416949 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-62a1a9f6-ff95-4b7e-ba05-fa2c3011c4d2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:09.417424 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-62a1a9f6-ff95-4b7e-ba05-fa2c3011c4d2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:09.417856 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-62a1a9f6-ff95-4b7e-ba05-fa2c3011c4d2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:09.418534 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-62a1a9f6-ff95-4b7e-ba05-fa2c3011c4d2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:09.418985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-62a1a9f6-ff95-4b7e-ba05-fa2c3011c4d2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:09.419433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-62a1a9f6-ff95-4b7e-ba05-fa2c3011c4d2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:09.548898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-62a1a9f6-ff95-4b7e-ba05-fa2c3011c4d2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:09.558084 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-62a1a9f6-ff95-4b7e-ba05-fa2c3011c4d2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.150875 Sep 09 13:19:09.558635 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 306/625] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:09 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:09.562939 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-474984e5-0b5f-41ca-a7b8-344945f90534 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:09.563602 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-474984e5-0b5f-41ca-a7b8-344945f90534 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:09.569082 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-474984e5-0b5f-41ca-a7b8-344945f90534 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:09.569571 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-474984e5-0b5f-41ca-a7b8-344945f90534 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:09.570002 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-474984e5-0b5f-41ca-a7b8-344945f90534 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:09.570684 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-474984e5-0b5f-41ca-a7b8-344945f90534 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:09.571169 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-474984e5-0b5f-41ca-a7b8-344945f90534 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:09.571594 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-474984e5-0b5f-41ca-a7b8-344945f90534 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:09.637411 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-474984e5-0b5f-41ca-a7b8-344945f90534 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:09.645139 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-474984e5-0b5f-41ca-a7b8-344945f90534 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1614 microversion: 2.1 time: 0.085526 Sep 09 13:19:09.650578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 307/626] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:09 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:09.939643 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-99715735-e367-4940-a3c9-059dece72f4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:09.940630 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-99715735-e367-4940-a3c9-059dece72f4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:09.948225 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99715735-e367-4940-a3c9-059dece72f4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:09.948725 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99715735-e367-4940-a3c9-059dece72f4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:09.949159 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99715735-e367-4940-a3c9-059dece72f4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:09.949864 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99715735-e367-4940-a3c9-059dece72f4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:09.950315 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99715735-e367-4940-a3c9-059dece72f4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:09.950742 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99715735-e367-4940-a3c9-059dece72f4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:10.081927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-99715735-e367-4940-a3c9-059dece72f4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:10.090948 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-99715735-e367-4940-a3c9-059dece72f4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:10.092342 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-99715735-e367-4940-a3c9-059dece72f4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:10.093493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-99715735-e367-4940-a3c9-059dece72f4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1721 microversion: 2.20 time: 0.159690 Sep 09 13:19:10.094118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 308/627] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:09 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:10.098437 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-fd664564-d726-4133-9ef1-a21943658fe3 req-98eab937-97ff-400c-9e3b-1e9f57876331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f961e5a-6c12-48b6-ae52-e61b993275b3", "name": "network-vif-unplugged", "status": "completed", "tag": "b38055a2-318f-4ddd-8392-48b0e32eee23"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:10.108877 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-fd664564-d726-4133-9ef1-a21943658fe3 req-98eab937-97ff-400c-9e3b-1e9f57876331 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:10.109374 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-fd664564-d726-4133-9ef1-a21943658fe3 req-98eab937-97ff-400c-9e3b-1e9f57876331 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:10.110030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-fd664564-d726-4133-9ef1-a21943658fe3 req-98eab937-97ff-400c-9e3b-1e9f57876331 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:10.122253 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-fd664564-d726-4133-9ef1-a21943658fe3 req-98eab937-97ff-400c-9e3b-1e9f57876331 service nova] Creating event network-vif-unplugged:b38055a2-318f-4ddd-8392-48b0e32eee23 for instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 on hv-cinder-83124 Sep 09 13:19:10.128073 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-fd664564-d726-4133-9ef1-a21943658fe3 req-98eab937-97ff-400c-9e3b-1e9f57876331 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032657 Sep 09 13:19:10.128873 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 309/628] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:10.402671 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3fbb034a-3fcd-46b3-b14b-aa012eddfc25 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:10.403393 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3fbb034a-3fcd-46b3-b14b-aa012eddfc25 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:10.409494 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fbb034a-3fcd-46b3-b14b-aa012eddfc25 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:10.409979 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fbb034a-3fcd-46b3-b14b-aa012eddfc25 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:10.410520 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fbb034a-3fcd-46b3-b14b-aa012eddfc25 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:10.411346 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fbb034a-3fcd-46b3-b14b-aa012eddfc25 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:10.411905 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fbb034a-3fcd-46b3-b14b-aa012eddfc25 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:10.412336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fbb034a-3fcd-46b3-b14b-aa012eddfc25 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:10.551898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3fbb034a-3fcd-46b3-b14b-aa012eddfc25 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:10.561282 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3fbb034a-3fcd-46b3-b14b-aa012eddfc25 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.163362 Sep 09 13:19:10.561930 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 310/629] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:10 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:10.579995 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fc483ef1-b1af-4978-a155-93a4094a9e06 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:10.580596 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fc483ef1-b1af-4978-a155-93a4094a9e06 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:10.586439 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc483ef1-b1af-4978-a155-93a4094a9e06 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:10.586908 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc483ef1-b1af-4978-a155-93a4094a9e06 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:10.587365 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc483ef1-b1af-4978-a155-93a4094a9e06 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:10.588041 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc483ef1-b1af-4978-a155-93a4094a9e06 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:10.588671 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc483ef1-b1af-4978-a155-93a4094a9e06 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:10.589293 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc483ef1-b1af-4978-a155-93a4094a9e06 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:10.609508 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:10.725545 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fc483ef1-b1af-4978-a155-93a4094a9e06 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:10.734310 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fc483ef1-b1af-4978-a155-93a4094a9e06 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.157866 Sep 09 13:19:10.734956 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 311/630] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:10 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:10.740529 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-96eb60ed-d8a3-47c2-9bb2-7e885ec2412f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:10.741132 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-96eb60ed-d8a3-47c2-9bb2-7e885ec2412f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:10.747598 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96eb60ed-d8a3-47c2-9bb2-7e885ec2412f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:10.748077 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96eb60ed-d8a3-47c2-9bb2-7e885ec2412f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:10.748509 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96eb60ed-d8a3-47c2-9bb2-7e885ec2412f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:10.749188 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96eb60ed-d8a3-47c2-9bb2-7e885ec2412f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:10.749639 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96eb60ed-d8a3-47c2-9bb2-7e885ec2412f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:10.750062 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96eb60ed-d8a3-47c2-9bb2-7e885ec2412f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:10.780390 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96eb60ed-d8a3-47c2-9bb2-7e885ec2412f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:10.780860 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96eb60ed-d8a3-47c2-9bb2-7e885ec2412f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:10.781297 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-96eb60ed-d8a3-47c2-9bb2-7e885ec2412f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:10.781736 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-96eb60ed-d8a3-47c2-9bb2-7e885ec2412f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lazy-loading 'fault' on Instance uuid 14183836-171b-4a21-ae32-a214060081e8 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:19:10.821591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-96eb60ed-d8a3-47c2-9bb2-7e885ec2412f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:10.829342 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-96eb60ed-d8a3-47c2-9bb2-7e885ec2412f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 200 len: 1330 microversion: 2.1 time: 0.093096 Sep 09 13:19:10.829908 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 312/631] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:10 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:11.089591 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-210e5531-39cd-499d-86be-323fecc1ad5e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "POST /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.251021 Sep 09 13:19:11.095537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 320/632] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 13:19:06 2022] POST /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments => generated 194 bytes in 4253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:11.121182 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1fa9e11e-e791-41ad-9761-2c5c69723ca2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:11.121965 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1fa9e11e-e791-41ad-9761-2c5c69723ca2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:11.128535 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1fa9e11e-e791-41ad-9761-2c5c69723ca2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:11.129029 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1fa9e11e-e791-41ad-9761-2c5c69723ca2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:11.129475 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1fa9e11e-e791-41ad-9761-2c5c69723ca2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:11.130324 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1fa9e11e-e791-41ad-9761-2c5c69723ca2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:11.130794 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1fa9e11e-e791-41ad-9761-2c5c69723ca2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:11.131256 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1fa9e11e-e791-41ad-9761-2c5c69723ca2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:11.270454 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1fa9e11e-e791-41ad-9761-2c5c69723ca2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:11.279323 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1fa9e11e-e791-41ad-9761-2c5c69723ca2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:11.280760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1fa9e11e-e791-41ad-9761-2c5c69723ca2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:11.281906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1fa9e11e-e791-41ad-9761-2c5c69723ca2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1724 microversion: 2.20 time: 0.165613 Sep 09 13:19:11.282483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 313/633] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:11 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:11.307397 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fd9a4d54-f3e2-4ea2-9b2e-0264286dc07f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51ef9e0b-7a53-437c-a631-ca5155edb1d4"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:11.309907 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fd9a4d54-f3e2-4ea2-9b2e-0264286dc07f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:11.316064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd9a4d54-f3e2-4ea2-9b2e-0264286dc07f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:11.316544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd9a4d54-f3e2-4ea2-9b2e-0264286dc07f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:11.316978 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd9a4d54-f3e2-4ea2-9b2e-0264286dc07f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:11.317661 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd9a4d54-f3e2-4ea2-9b2e-0264286dc07f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:11.318110 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd9a4d54-f3e2-4ea2-9b2e-0264286dc07f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:11.318528 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fd9a4d54-f3e2-4ea2-9b2e-0264286dc07f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:11.589092 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-214624b9-8e24-4abd-be13-fcb226ed3fce tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:11.590468 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-214624b9-8e24-4abd-be13-fcb226ed3fce tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:11.601199 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-214624b9-8e24-4abd-be13-fcb226ed3fce tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:11.601901 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-214624b9-8e24-4abd-be13-fcb226ed3fce tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:11.602607 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-214624b9-8e24-4abd-be13-fcb226ed3fce tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:11.603789 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-214624b9-8e24-4abd-be13-fcb226ed3fce tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:11.604388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-214624b9-8e24-4abd-be13-fcb226ed3fce tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:11.605478 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-214624b9-8e24-4abd-be13-fcb226ed3fce tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:11.797546 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-214624b9-8e24-4abd-be13-fcb226ed3fce tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:11.806266 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-214624b9-8e24-4abd-be13-fcb226ed3fce tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.225150 Sep 09 13:19:11.808450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 314/634] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:11 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:11.814396 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fd9a4d54-f3e2-4ea2-9b2e-0264286dc07f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "POST /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.511754 Sep 09 13:19:11.815112 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 321/635] 10.222.0.17 () {62 vars in 1364 bytes} [Fri Sep 9 13:19:11 2022] POST /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-volume_attachments => generated 188 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:19:11.830293 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9624831f-f9fd-4b0a-97aa-85b286c79359 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:11.831127 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9624831f-f9fd-4b0a-97aa-85b286c79359 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:11.836864 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9624831f-f9fd-4b0a-97aa-85b286c79359 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:11.837340 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9624831f-f9fd-4b0a-97aa-85b286c79359 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:11.837952 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9624831f-f9fd-4b0a-97aa-85b286c79359 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:11.838911 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9624831f-f9fd-4b0a-97aa-85b286c79359 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:11.839542 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9624831f-f9fd-4b0a-97aa-85b286c79359 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:11.839995 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9624831f-f9fd-4b0a-97aa-85b286c79359 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:11.853412 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34c5b740-cefb-43b3-9a04-52f941f68251 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:11.854160 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-34c5b740-cefb-43b3-9a04-52f941f68251 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:11.860918 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34c5b740-cefb-43b3-9a04-52f941f68251 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:11.862004 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34c5b740-cefb-43b3-9a04-52f941f68251 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:11.862453 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34c5b740-cefb-43b3-9a04-52f941f68251 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:11.863460 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34c5b740-cefb-43b3-9a04-52f941f68251 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:11.864223 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34c5b740-cefb-43b3-9a04-52f941f68251 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:11.864816 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-34c5b740-cefb-43b3-9a04-52f941f68251 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:11.880043 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-34c5b740-cefb-43b3-9a04-52f941f68251 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] HTTP exception thrown: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34c5b740-cefb-43b3-9a04-52f941f68251 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Request method failure captured: Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 HTTP/1.1 Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzxOEkSw_D0B2DWW3aDp6JHSyeYSFkFADbNPgrw4so5mlP-Ugc06W6Rkqydb-b3AAsVzR7p1RzJdXA1668TSyot_sK8AkXdZkK5Jg9C97nHfO5kDuLQSdUnou_VoOzEQjYwBo46vUgiPeKNiJ0QlKMZ9JN2CFXzSZOPwjJ0bmZDR7mw Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:19:11.881752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:19:11.883356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6b24b42ca93941aa8e70f5fa10303f4d", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:19:11.883356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:19:11.883356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:19:11.883356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:19:11.883356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:19:11.883356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:19:11.883356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:19:11.883356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: dcb88983a8e1439588644b71170d7362 Sep 09 13:19:11.883356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:19:11.883356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:19:11.883356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:19:11.883356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '14183836-171b-4a21-ae32-a214060081e8'} Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:19:11.884262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:19:11.886008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:19:11.890411 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-34c5b740-cefb-43b3-9a04-52f941f68251 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Returning 404 to user: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:19:11.891309 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-34c5b740-cefb-43b3-9a04-52f941f68251 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 404 len: 111 microversion: 2.1 time: 0.042739 Sep 09 13:19:11.891869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 322/636] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:11 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:19:11.900105 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b9abe580-cc76-4032-ae6e-7be7057391dd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '.version_select at 0x7fd4a177eb80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:11.921823 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b9abe580-cc76-4032-ae6e-7be7057391dd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1406340475" status: 202 len: 0 microversion: 2.1 time: 0.025276 Sep 09 13:19:11.922597 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 323/637] 10.222.0.17 () {58 vars in 1221 bytes} [Fri Sep 9 13:19:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1406340475 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:19:11.955781 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2c404ee9-29f0-4a2a-b0ab-acbfae2095ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:11.956376 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2c404ee9-29f0-4a2a-b0ab-acbfae2095ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:11.962983 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c404ee9-29f0-4a2a-b0ab-acbfae2095ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:11.963644 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c404ee9-29f0-4a2a-b0ab-acbfae2095ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:11.964082 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c404ee9-29f0-4a2a-b0ab-acbfae2095ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:11.964887 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c404ee9-29f0-4a2a-b0ab-acbfae2095ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:11.965343 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c404ee9-29f0-4a2a-b0ab-acbfae2095ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:11.965768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c404ee9-29f0-4a2a-b0ab-acbfae2095ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:11.985532 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9624831f-f9fd-4b0a-97aa-85b286c79359 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:11.993183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9624831f-f9fd-4b0a-97aa-85b286c79359 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.172683 Sep 09 13:19:11.998084 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 315/638] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:11 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:12.019603 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2c404ee9-29f0-4a2a-b0ab-acbfae2095ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120625) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 13:19:12.092177 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2c404ee9-29f0-4a2a-b0ab-acbfae2095ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "POST /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/action" status: 202 len: 0 microversion: 2.20 time: 0.140450 Sep 09 13:19:12.093135 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 324/639] 10.222.0.17 () {62 vars in 1319 bytes} [Fri Sep 9 13:19:11 2022] POST /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 09 13:19:12.101901 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-77873e97-de08-4566-be88-5c4b9da72f9c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:12.102744 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-77873e97-de08-4566-be88-5c4b9da72f9c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:12.110463 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77873e97-de08-4566-be88-5c4b9da72f9c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:12.111544 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77873e97-de08-4566-be88-5c4b9da72f9c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:12.112124 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77873e97-de08-4566-be88-5c4b9da72f9c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:12.112824 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77873e97-de08-4566-be88-5c4b9da72f9c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:12.113409 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77873e97-de08-4566-be88-5c4b9da72f9c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:12.113848 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-77873e97-de08-4566-be88-5c4b9da72f9c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:12.363372 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-77873e97-de08-4566-be88-5c4b9da72f9c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:12.373506 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-77873e97-de08-4566-be88-5c4b9da72f9c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:12.375038 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-77873e97-de08-4566-be88-5c4b9da72f9c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:12.376300 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-77873e97-de08-4566-be88-5c4b9da72f9c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1810 microversion: 2.20 time: 0.278769 Sep 09 13:19:12.377132 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 316/640] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:12 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1810 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:12.692070 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ad4ba41f-cbaa-42ad-ae77-c2606bfe228b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Action: 'create', calling method: .version_select at 0x7fd4a178ab80>, body: {"keypair": {"name": "tempest-keypair-1754036516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfddoP2TcWvSr8umAAV+zsjZuDAqNX/haDEj06hgcpx9ol8aZnDFXQ1Zq55tnfbHqxxCboQMkv7IU7SIFNB+4xW0sfeuyilos13EbiUP09gFJk8mEp/4E92nc/nZ9mAcw=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:12.707196 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-ad4ba41f-cbaa-42ad-ae77-c2606bfe228b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:19:12.710948 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-ad4ba41f-cbaa-42ad-ae77-c2606bfe228b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for user dcb88983a8e1439588644b71170d7362 and project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:19:12.734210 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ad4ba41f-cbaa-42ad-ae77-c2606bfe228b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046351 Sep 09 13:19:12.734807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 325/641] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 13:19:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:12.834755 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fafec8ab-0135-43a6-b26f-40b7781f6a44 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:12.835419 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fafec8ab-0135-43a6-b26f-40b7781f6a44 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:12.843656 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fafec8ab-0135-43a6-b26f-40b7781f6a44 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:12.844343 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fafec8ab-0135-43a6-b26f-40b7781f6a44 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:12.845168 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fafec8ab-0135-43a6-b26f-40b7781f6a44 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:12.846211 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fafec8ab-0135-43a6-b26f-40b7781f6a44 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:12.846669 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fafec8ab-0135-43a6-b26f-40b7781f6a44 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:12.847315 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fafec8ab-0135-43a6-b26f-40b7781f6a44 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:13.017318 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-865024b8-90b1-4992-bf58-a1199d68aa92 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:13.018270 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-865024b8-90b1-4992-bf58-a1199d68aa92 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:13.025249 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-865024b8-90b1-4992-bf58-a1199d68aa92 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:13.026657 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-865024b8-90b1-4992-bf58-a1199d68aa92 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:13.027364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-865024b8-90b1-4992-bf58-a1199d68aa92 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:13.028325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-865024b8-90b1-4992-bf58-a1199d68aa92 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:13.028853 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-865024b8-90b1-4992-bf58-a1199d68aa92 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:13.029345 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-865024b8-90b1-4992-bf58-a1199d68aa92 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:13.057455 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fafec8ab-0135-43a6-b26f-40b7781f6a44 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:13.070688 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fafec8ab-0135-43a6-b26f-40b7781f6a44 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.239053 Sep 09 13:19:13.072197 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 317/642] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:12 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:13.191734 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-865024b8-90b1-4992-bf58-a1199d68aa92 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:13.199634 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-865024b8-90b1-4992-bf58-a1199d68aa92 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.186615 Sep 09 13:19:13.200197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 326/643] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:13 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:13.402328 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1d7f5be9-5b25-43d5-b9d6-0bd2a9c02563 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:13.408270 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1d7f5be9-5b25-43d5-b9d6-0bd2a9c02563 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:13.414379 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d7f5be9-5b25-43d5-b9d6-0bd2a9c02563 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:13.415131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d7f5be9-5b25-43d5-b9d6-0bd2a9c02563 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:13.415574 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d7f5be9-5b25-43d5-b9d6-0bd2a9c02563 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:13.416273 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d7f5be9-5b25-43d5-b9d6-0bd2a9c02563 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:13.417317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d7f5be9-5b25-43d5-b9d6-0bd2a9c02563 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:13.417852 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1d7f5be9-5b25-43d5-b9d6-0bd2a9c02563 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:13.617192 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1d7f5be9-5b25-43d5-b9d6-0bd2a9c02563 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:13.640270 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1d7f5be9-5b25-43d5-b9d6-0bd2a9c02563 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:13.641728 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1d7f5be9-5b25-43d5-b9d6-0bd2a9c02563 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:13.642912 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1d7f5be9-5b25-43d5-b9d6-0bd2a9c02563 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1810 microversion: 2.20 time: 0.245093 Sep 09 13:19:13.643824 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 318/644] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:13 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:14.097593 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a7d8733b-9ead-475a-852f-4f853470efb5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:14.098204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a7d8733b-9ead-475a-852f-4f853470efb5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:14.105307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7d8733b-9ead-475a-852f-4f853470efb5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:14.105743 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7d8733b-9ead-475a-852f-4f853470efb5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:14.106215 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7d8733b-9ead-475a-852f-4f853470efb5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:14.106921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7d8733b-9ead-475a-852f-4f853470efb5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:14.107402 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7d8733b-9ead-475a-852f-4f853470efb5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:14.107832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a7d8733b-9ead-475a-852f-4f853470efb5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:14.193451 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-884232986", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2956cf21-dbaf-41ce-8ac8-8e3d7c788d07"}], "security_groups": [{"name": "tempest-securitygroup--563685150"}], "key_name": "tempest-keypair-1754036516", "user_data": "}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:14.240343 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a7d8733b-9ead-475a-852f-4f853470efb5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:14.250003 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a7d8733b-9ead-475a-852f-4f853470efb5 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.156275 Sep 09 13:19:14.250567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 327/645] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:14 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:14.254952 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fee0e020-0963-40eb-998a-c48cd983fad4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:14.255674 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fee0e020-0963-40eb-998a-c48cd983fad4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:14.261678 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fee0e020-0963-40eb-998a-c48cd983fad4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:14.262159 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fee0e020-0963-40eb-998a-c48cd983fad4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:14.262588 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fee0e020-0963-40eb-998a-c48cd983fad4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:14.263307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fee0e020-0963-40eb-998a-c48cd983fad4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:14.263759 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fee0e020-0963-40eb-998a-c48cd983fad4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:14.264183 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fee0e020-0963-40eb-998a-c48cd983fad4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:14.301390 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] validate_networks() for [('2956cf21-dbaf-41ce-8ac8-8e3d7c788d07', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:19:14.410385 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fee0e020-0963-40eb-998a-c48cd983fad4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:14.421155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fee0e020-0963-40eb-998a-c48cd983fad4 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.169452 Sep 09 13:19:14.421856 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 328/646] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:14 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:14.677080 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a2e3f4d3-6ed1-4503-a2d4-2879cfe33a1d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:14.677967 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a2e3f4d3-6ed1-4503-a2d4-2879cfe33a1d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:14.685019 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2e3f4d3-6ed1-4503-a2d4-2879cfe33a1d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:14.685763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2e3f4d3-6ed1-4503-a2d4-2879cfe33a1d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:14.686443 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2e3f4d3-6ed1-4503-a2d4-2879cfe33a1d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:14.693084 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2e3f4d3-6ed1-4503-a2d4-2879cfe33a1d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:14.694343 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2e3f4d3-6ed1-4503-a2d4-2879cfe33a1d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:14.695012 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a2e3f4d3-6ed1-4503-a2d4-2879cfe33a1d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:14.701594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:14.810978 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:14.920975 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2e3f4d3-6ed1-4503-a2d4-2879cfe33a1d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:14.933035 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2e3f4d3-6ed1-4503-a2d4-2879cfe33a1d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:14.935153 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a2e3f4d3-6ed1-4503-a2d4-2879cfe33a1d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:14.937109 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a2e3f4d3-6ed1-4503-a2d4-2879cfe33a1d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1810 microversion: 2.20 time: 0.265346 Sep 09 13:19:14.955914 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 329/647] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:14 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1810 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:19:14.964581 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-965499148", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "networks": [{"uuid": "8e97ca6e-874b-4bc3-8a46-7260e60d3561"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:14.997393 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:19:14.997827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:19:14.998309 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:19:14.998733 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:19:14.999340 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:19:15.010630 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:15.011146 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:15.011775 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:15.012669 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:15.013346 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:15.013785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:15.031148 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] validate_networks() for [('8e97ca6e-874b-4bc3-8a46-7260e60d3561', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:19:15.031362 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:19:15.035374 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for user dcb88983a8e1439588644b71170d7362 and project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:19:15.046695 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:19:15.049050 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:19:15.097870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9703e418-e960-405f-ad0a-0bb3e66ff66d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.908565 Sep 09 13:19:15.098691 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 319/648] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:19:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 13:19:15.109716 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-dc59905f-6c50-47b3-94c6-d22973c41556 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:15.110330 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-dc59905f-6c50-47b3-94c6-d22973c41556 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:15.172478 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-dc59905f-6c50-47b3-94c6-d22973c41556 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:15.180165 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-dc59905f-6c50-47b3-94c6-d22973c41556 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1241 microversion: 2.1 time: 0.074331 Sep 09 13:19:15.180921 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 320/649] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:15 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:15.273139 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9a15eda2-8a51-488a-ba3e-1dd2004df9ad tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:15.273764 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9a15eda2-8a51-488a-ba3e-1dd2004df9ad tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:15.281291 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a15eda2-8a51-488a-ba3e-1dd2004df9ad tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:15.281865 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a15eda2-8a51-488a-ba3e-1dd2004df9ad tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:15.282381 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a15eda2-8a51-488a-ba3e-1dd2004df9ad tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:15.283180 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a15eda2-8a51-488a-ba3e-1dd2004df9ad tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:15.283885 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a15eda2-8a51-488a-ba3e-1dd2004df9ad tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:15.284708 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9a15eda2-8a51-488a-ba3e-1dd2004df9ad tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:15.422311 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:19:15.422812 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:19:15.423467 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:19:15.423872 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:19:15.424277 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:19:15.434291 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:15.435271 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:15.435389 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:15.436185 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:15.436823 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:15.437356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:15.440281 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9a15eda2-8a51-488a-ba3e-1dd2004df9ad tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:15.451035 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9a15eda2-8a51-488a-ba3e-1dd2004df9ad tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.181458 Sep 09 13:19:15.455665 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 321/650] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:15 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:15.456777 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Getting quotas for project 345a9eb6369c43a681649f1bb55ce60c. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:19:15.458653 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f85cbd1b-96f5-4767-aa95-ef53ae5e4fc7 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:15.459647 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f85cbd1b-96f5-4767-aa95-ef53ae5e4fc7 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:15.460890 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Getting quotas for user 41ec6426ddf640389083cc61e948d31f and project 345a9eb6369c43a681649f1bb55ce60c. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:19:15.467140 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f85cbd1b-96f5-4767-aa95-ef53ae5e4fc7 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:15.467707 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f85cbd1b-96f5-4767-aa95-ef53ae5e4fc7 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:15.468221 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f85cbd1b-96f5-4767-aa95-ef53ae5e4fc7 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:15.468994 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f85cbd1b-96f5-4767-aa95-ef53ae5e4fc7 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:15.469523 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f85cbd1b-96f5-4767-aa95-ef53ae5e4fc7 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:15.470039 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f85cbd1b-96f5-4767-aa95-ef53ae5e4fc7 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:15.472980 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:19:15.475321 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:19:15.528016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ca1c246d-e904-475e-8e34-f843e7b709a9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570638 Sep 09 13:19:15.528725 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 330/651] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:19:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:19:15.541196 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-92c089b5-c00d-4b53-9ebd-4807a9b90d68 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:15.542666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-92c089b5-c00d-4b53-9ebd-4807a9b90d68 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:15.614538 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-92c089b5-c00d-4b53-9ebd-4807a9b90d68 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:15.618135 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f85cbd1b-96f5-4767-aa95-ef53ae5e4fc7 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:15.622980 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-92c089b5-c00d-4b53-9ebd-4807a9b90d68 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1218 microversion: 2.1 time: 0.086115 Sep 09 13:19:15.623682 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 331/652] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:15 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:15.627695 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f85cbd1b-96f5-4767-aa95-ef53ae5e4fc7 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.174500 Sep 09 13:19:15.628444 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 322/653] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:15 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:15.967512 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b3835700-b6f8-4e99-b841-e3a9e7bad5b3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:15.968205 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b3835700-b6f8-4e99-b841-e3a9e7bad5b3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:15.974493 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3835700-b6f8-4e99-b841-e3a9e7bad5b3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:15.974977 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3835700-b6f8-4e99-b841-e3a9e7bad5b3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:15.975455 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3835700-b6f8-4e99-b841-e3a9e7bad5b3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:15.976147 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3835700-b6f8-4e99-b841-e3a9e7bad5b3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:15.976601 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3835700-b6f8-4e99-b841-e3a9e7bad5b3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:15.977026 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b3835700-b6f8-4e99-b841-e3a9e7bad5b3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:16.125718 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b3835700-b6f8-4e99-b841-e3a9e7bad5b3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:16.134296 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b3835700-b6f8-4e99-b841-e3a9e7bad5b3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:16.136077 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b3835700-b6f8-4e99-b841-e3a9e7bad5b3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:16.137223 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b3835700-b6f8-4e99-b841-e3a9e7bad5b3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1752 microversion: 2.20 time: 0.173906 Sep 09 13:19:16.137773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 332/654] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:15 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:16.201739 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-73c7dc02-ba53-4dfa-aee0-72a33cbf08d2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:16.202351 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-73c7dc02-ba53-4dfa-aee0-72a33cbf08d2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:16.208339 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73c7dc02-ba53-4dfa-aee0-72a33cbf08d2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:16.208815 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73c7dc02-ba53-4dfa-aee0-72a33cbf08d2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:16.209248 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73c7dc02-ba53-4dfa-aee0-72a33cbf08d2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:16.209927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73c7dc02-ba53-4dfa-aee0-72a33cbf08d2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:16.210384 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73c7dc02-ba53-4dfa-aee0-72a33cbf08d2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:16.210807 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73c7dc02-ba53-4dfa-aee0-72a33cbf08d2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:16.278240 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-73c7dc02-ba53-4dfa-aee0-72a33cbf08d2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:16.285828 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-73c7dc02-ba53-4dfa-aee0-72a33cbf08d2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1293 microversion: 2.1 time: 0.088068 Sep 09 13:19:16.286425 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 323/655] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:16 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:16.477660 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-765ba441-7a27-4296-af3b-afafd907e769 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:16.478361 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-765ba441-7a27-4296-af3b-afafd907e769 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:16.485918 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-765ba441-7a27-4296-af3b-afafd907e769 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:16.486680 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-765ba441-7a27-4296-af3b-afafd907e769 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:16.487490 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-765ba441-7a27-4296-af3b-afafd907e769 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:16.489729 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-765ba441-7a27-4296-af3b-afafd907e769 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:16.490893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-765ba441-7a27-4296-af3b-afafd907e769 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:16.491345 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-765ba441-7a27-4296-af3b-afafd907e769 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:16.648097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e928430f-ab17-4f99-8591-45be1daf03fb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:16.648823 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e928430f-ab17-4f99-8591-45be1daf03fb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:16.656881 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-765ba441-7a27-4296-af3b-afafd907e769 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:16.657636 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e928430f-ab17-4f99-8591-45be1daf03fb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:16.658201 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e928430f-ab17-4f99-8591-45be1daf03fb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:16.658712 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e928430f-ab17-4f99-8591-45be1daf03fb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:16.659648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e928430f-ab17-4f99-8591-45be1daf03fb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:16.660187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e928430f-ab17-4f99-8591-45be1daf03fb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:16.660683 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e928430f-ab17-4f99-8591-45be1daf03fb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:16.666861 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-765ba441-7a27-4296-af3b-afafd907e769 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.194265 Sep 09 13:19:16.679267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 333/656] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:16 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:16.679267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ab97ce89-b9f5-4ba3-9adc-91d3f474f6b1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:16.679267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ab97ce89-b9f5-4ba3-9adc-91d3f474f6b1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:16.679267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab97ce89-b9f5-4ba3-9adc-91d3f474f6b1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:16.679267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab97ce89-b9f5-4ba3-9adc-91d3f474f6b1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:16.679814 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab97ce89-b9f5-4ba3-9adc-91d3f474f6b1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:16.683865 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab97ce89-b9f5-4ba3-9adc-91d3f474f6b1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:16.683865 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab97ce89-b9f5-4ba3-9adc-91d3f474f6b1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:16.683865 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ab97ce89-b9f5-4ba3-9adc-91d3f474f6b1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:16.727967 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e928430f-ab17-4f99-8591-45be1daf03fb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:16.737635 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e928430f-ab17-4f99-8591-45be1daf03fb tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1270 microversion: 2.1 time: 0.093723 Sep 09 13:19:16.738571 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 324/657] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:16 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:16.842974 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ab97ce89-b9f5-4ba3-9adc-91d3f474f6b1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:16.850881 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ab97ce89-b9f5-4ba3-9adc-91d3f474f6b1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.182239 Sep 09 13:19:16.851517 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 334/658] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:16 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:16.860236 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-7b7f3a85-6e01-4246-ad5d-52e5fa7343f4 req-950ab9da-868a-41c5-befc-92e88a3eb8fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76473280-a8d1-4fed-a202-c9825247c44b", "name": "network-vif-plugged", "status": "completed", "tag": "48049b9e-9115-47c4-97e1-b44a8a86aef3"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:16.871120 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-7b7f3a85-6e01-4246-ad5d-52e5fa7343f4 req-950ab9da-868a-41c5-befc-92e88a3eb8fa service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:16.871688 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-7b7f3a85-6e01-4246-ad5d-52e5fa7343f4 req-950ab9da-868a-41c5-befc-92e88a3eb8fa service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:16.872188 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-7b7f3a85-6e01-4246-ad5d-52e5fa7343f4 req-950ab9da-868a-41c5-befc-92e88a3eb8fa service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:16.885195 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-7b7f3a85-6e01-4246-ad5d-52e5fa7343f4 req-950ab9da-868a-41c5-befc-92e88a3eb8fa service nova] Creating event network-vif-plugged:48049b9e-9115-47c4-97e1-b44a8a86aef3 for instance 76473280-a8d1-4fed-a202-c9825247c44b on hv-cinder-83124 Sep 09 13:19:16.890670 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-7b7f3a85-6e01-4246-ad5d-52e5fa7343f4 req-950ab9da-868a-41c5-befc-92e88a3eb8fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038325 Sep 09 13:19:16.891303 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 325/659] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:17.165210 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6c41a437-454f-453e-85ee-c5a5a07400b0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:17.165835 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6c41a437-454f-453e-85ee-c5a5a07400b0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:17.174707 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c41a437-454f-453e-85ee-c5a5a07400b0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:17.175252 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c41a437-454f-453e-85ee-c5a5a07400b0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:17.175697 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c41a437-454f-453e-85ee-c5a5a07400b0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:17.176654 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c41a437-454f-453e-85ee-c5a5a07400b0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:17.176868 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c41a437-454f-453e-85ee-c5a5a07400b0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:17.177292 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6c41a437-454f-453e-85ee-c5a5a07400b0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:17.311303 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8d3e1d93-28bf-4a34-9c45-dc40d55bfce4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:17.312022 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8d3e1d93-28bf-4a34-9c45-dc40d55bfce4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:17.318951 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d3e1d93-28bf-4a34-9c45-dc40d55bfce4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:17.319624 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d3e1d93-28bf-4a34-9c45-dc40d55bfce4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:17.320062 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d3e1d93-28bf-4a34-9c45-dc40d55bfce4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:17.320937 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d3e1d93-28bf-4a34-9c45-dc40d55bfce4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:17.321562 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d3e1d93-28bf-4a34-9c45-dc40d55bfce4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:17.322141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d3e1d93-28bf-4a34-9c45-dc40d55bfce4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:17.326357 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6c41a437-454f-453e-85ee-c5a5a07400b0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:17.335374 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6c41a437-454f-453e-85ee-c5a5a07400b0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:17.336819 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6c41a437-454f-453e-85ee-c5a5a07400b0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:17.337977 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6c41a437-454f-453e-85ee-c5a5a07400b0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1752 microversion: 2.20 time: 0.178645 Sep 09 13:19:17.339006 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 335/660] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:17 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:17.411931 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8d3e1d93-28bf-4a34-9c45-dc40d55bfce4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:17.420623 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8d3e1d93-28bf-4a34-9c45-dc40d55bfce4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1299 microversion: 2.1 time: 0.115424 Sep 09 13:19:17.421562 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 326/661] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:17 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:17.691852 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2a1107bb-ab94-4e6f-8707-4ed06a493fd7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:17.692655 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2a1107bb-ab94-4e6f-8707-4ed06a493fd7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:17.705758 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a1107bb-ab94-4e6f-8707-4ed06a493fd7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:17.706257 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a1107bb-ab94-4e6f-8707-4ed06a493fd7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:17.709003 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a1107bb-ab94-4e6f-8707-4ed06a493fd7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:17.709896 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a1107bb-ab94-4e6f-8707-4ed06a493fd7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:17.710314 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a1107bb-ab94-4e6f-8707-4ed06a493fd7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:17.710825 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2a1107bb-ab94-4e6f-8707-4ed06a493fd7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:17.763132 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-51ecf333-a34c-4cb8-8709-fa8e325f3194 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:17.764063 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-51ecf333-a34c-4cb8-8709-fa8e325f3194 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:17.766864 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:17.778587 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51ecf333-a34c-4cb8-8709-fa8e325f3194 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:17.779723 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51ecf333-a34c-4cb8-8709-fa8e325f3194 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:17.781316 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51ecf333-a34c-4cb8-8709-fa8e325f3194 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:17.782656 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51ecf333-a34c-4cb8-8709-fa8e325f3194 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:17.783909 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51ecf333-a34c-4cb8-8709-fa8e325f3194 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:17.784726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-51ecf333-a34c-4cb8-8709-fa8e325f3194 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:17.877749 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-51ecf333-a34c-4cb8-8709-fa8e325f3194 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:17.889698 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-51ecf333-a34c-4cb8-8709-fa8e325f3194 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1270 microversion: 2.1 time: 0.131686 Sep 09 13:19:17.907689 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 327/662] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:17 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:17.915392 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f5a65da0-0b3a-461e-8d1b-945682ab589a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:17.916374 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f5a65da0-0b3a-461e-8d1b-945682ab589a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:17.923423 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f5a65da0-0b3a-461e-8d1b-945682ab589a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:17.923915 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f5a65da0-0b3a-461e-8d1b-945682ab589a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:17.924569 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f5a65da0-0b3a-461e-8d1b-945682ab589a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:17.925291 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f5a65da0-0b3a-461e-8d1b-945682ab589a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:17.925747 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f5a65da0-0b3a-461e-8d1b-945682ab589a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:17.926175 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f5a65da0-0b3a-461e-8d1b-945682ab589a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:17.957369 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2a1107bb-ab94-4e6f-8707-4ed06a493fd7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:17.971874 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2a1107bb-ab94-4e6f-8707-4ed06a493fd7 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.283298 Sep 09 13:19:17.979540 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 336/663] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:17 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:18.184619 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f5a65da0-0b3a-461e-8d1b-945682ab589a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:18.192347 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f5a65da0-0b3a-461e-8d1b-945682ab589a tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.283394 Sep 09 13:19:18.192921 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 328/664] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:17 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:18.378719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-77f307ff-a896-4f9f-8e6a-d4c5fd7c4d2c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:18.379361 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-77f307ff-a896-4f9f-8e6a-d4c5fd7c4d2c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:18.386639 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77f307ff-a896-4f9f-8e6a-d4c5fd7c4d2c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:18.387526 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77f307ff-a896-4f9f-8e6a-d4c5fd7c4d2c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:18.388287 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77f307ff-a896-4f9f-8e6a-d4c5fd7c4d2c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:18.389383 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77f307ff-a896-4f9f-8e6a-d4c5fd7c4d2c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:18.389927 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77f307ff-a896-4f9f-8e6a-d4c5fd7c4d2c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:18.390456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-77f307ff-a896-4f9f-8e6a-d4c5fd7c4d2c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:18.445468 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-93de7124-fd86-4b83-a9db-4808fbc442e3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:18.446011 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-93de7124-fd86-4b83-a9db-4808fbc442e3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:18.453601 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93de7124-fd86-4b83-a9db-4808fbc442e3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:18.454662 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93de7124-fd86-4b83-a9db-4808fbc442e3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:18.455350 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93de7124-fd86-4b83-a9db-4808fbc442e3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:18.456294 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93de7124-fd86-4b83-a9db-4808fbc442e3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:18.456966 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93de7124-fd86-4b83-a9db-4808fbc442e3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:18.457657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-93de7124-fd86-4b83-a9db-4808fbc442e3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:18.653048 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-77f307ff-a896-4f9f-8e6a-d4c5fd7c4d2c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:18.662568 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-77f307ff-a896-4f9f-8e6a-d4c5fd7c4d2c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:18.665729 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-77f307ff-a896-4f9f-8e6a-d4c5fd7c4d2c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:18.667929 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-77f307ff-a896-4f9f-8e6a-d4c5fd7c4d2c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1752 microversion: 2.20 time: 0.292836 Sep 09 13:19:18.670064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 337/665] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:18 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1752 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:18.722609 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-93de7124-fd86-4b83-a9db-4808fbc442e3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:18.732727 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-93de7124-fd86-4b83-a9db-4808fbc442e3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.291986 Sep 09 13:19:18.733395 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 329/666] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:18 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:18.783913 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1e662e92-15e7-45f7-af6c-f602a0740784 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:18.785197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1e662e92-15e7-45f7-af6c-f602a0740784 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:18.792094 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e662e92-15e7-45f7-af6c-f602a0740784 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:18.792548 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e662e92-15e7-45f7-af6c-f602a0740784 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:18.792977 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e662e92-15e7-45f7-af6c-f602a0740784 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:18.793678 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e662e92-15e7-45f7-af6c-f602a0740784 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:18.794128 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e662e92-15e7-45f7-af6c-f602a0740784 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:18.794601 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e662e92-15e7-45f7-af6c-f602a0740784 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:18.819079 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-9b7bb3a6-6ea1-46dc-854c-843d603b9763 req-d3b4c54c-d580-4e11-9f8e-870bf6c62938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68162eb9-cbe5-401b-bd53-8a1a715bb164", "tag": "0fdd18ec-bd72-455b-b76a-776cd528e722"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:18.829472 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-9b7bb3a6-6ea1-46dc-854c-843d603b9763 req-d3b4c54c-d580-4e11-9f8e-870bf6c62938 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:18.830103 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-9b7bb3a6-6ea1-46dc-854c-843d603b9763 req-d3b4c54c-d580-4e11-9f8e-870bf6c62938 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:18.830639 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-9b7bb3a6-6ea1-46dc-854c-843d603b9763 req-d3b4c54c-d580-4e11-9f8e-870bf6c62938 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:18.834777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:18.844292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-9b7bb3a6-6ea1-46dc-854c-843d603b9763 req-d3b4c54c-d580-4e11-9f8e-870bf6c62938 service nova] Creating event network-changed:0fdd18ec-bd72-455b-b76a-776cd528e722 for instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 on hv-cinder-83124 Sep 09 13:19:18.849564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-9b7bb3a6-6ea1-46dc-854c-843d603b9763 req-d3b4c54c-d580-4e11-9f8e-870bf6c62938 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034039 Sep 09 13:19:18.850390 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 330/667] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:19:18.919174 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-87e40019-2fae-4a80-89a4-607b8563c056 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:18.919996 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-87e40019-2fae-4a80-89a4-607b8563c056 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:18.926748 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87e40019-2fae-4a80-89a4-607b8563c056 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:18.935756 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87e40019-2fae-4a80-89a4-607b8563c056 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:18.936503 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87e40019-2fae-4a80-89a4-607b8563c056 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:18.937285 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87e40019-2fae-4a80-89a4-607b8563c056 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:18.937720 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87e40019-2fae-4a80-89a4-607b8563c056 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:18.938129 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-87e40019-2fae-4a80-89a4-607b8563c056 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:18.947224 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1e662e92-15e7-45f7-af6c-f602a0740784 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:18.957959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1e662e92-15e7-45f7-af6c-f602a0740784 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1595 microversion: 2.1 time: 0.177847 Sep 09 13:19:18.958591 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 338/668] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:18 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1595 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:19.015158 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b5b64bd-7e66-436a-9762-fef185d96aca tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:19.019014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2b5b64bd-7e66-436a-9762-fef185d96aca tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:19.043752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b5b64bd-7e66-436a-9762-fef185d96aca tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:19.048761 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-87e40019-2fae-4a80-89a4-607b8563c056 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:19.052581 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b5b64bd-7e66-436a-9762-fef185d96aca tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:19.053054 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b5b64bd-7e66-436a-9762-fef185d96aca tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:19.053825 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b5b64bd-7e66-436a-9762-fef185d96aca tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:19.054293 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b5b64bd-7e66-436a-9762-fef185d96aca tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:19.054719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b5b64bd-7e66-436a-9762-fef185d96aca tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:19.061577 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-87e40019-2fae-4a80-89a4-607b8563c056 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1288 microversion: 2.1 time: 0.146974 Sep 09 13:19:19.062265 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 331/669] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:18 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1288 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:19.217180 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-65d7a5e3-30d7-41c6-8f26-3acea7c9bd5b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:19.217813 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-65d7a5e3-30d7-41c6-8f26-3acea7c9bd5b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:19.229748 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65d7a5e3-30d7-41c6-8f26-3acea7c9bd5b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:19.230336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65d7a5e3-30d7-41c6-8f26-3acea7c9bd5b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:19.230778 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65d7a5e3-30d7-41c6-8f26-3acea7c9bd5b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:19.231502 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65d7a5e3-30d7-41c6-8f26-3acea7c9bd5b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:19.232128 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65d7a5e3-30d7-41c6-8f26-3acea7c9bd5b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:19.232558 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65d7a5e3-30d7-41c6-8f26-3acea7c9bd5b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:19.345008 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2b5b64bd-7e66-436a-9762-fef185d96aca tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:19.354914 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b5b64bd-7e66-436a-9762-fef185d96aca tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.361748 Sep 09 13:19:19.356643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 339/670] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:18 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:19.556109 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-65d7a5e3-30d7-41c6-8f26-3acea7c9bd5b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:19.565948 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-65d7a5e3-30d7-41c6-8f26-3acea7c9bd5b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1260 microversion: 2.1 time: 0.352986 Sep 09 13:19:19.566533 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 332/671] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:19 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1260 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:19.696378 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb0b9e3f-e262-43f0-af92-c80fadf3d921 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:19.696999 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fb0b9e3f-e262-43f0-af92-c80fadf3d921 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:19.704208 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb0b9e3f-e262-43f0-af92-c80fadf3d921 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:19.704702 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb0b9e3f-e262-43f0-af92-c80fadf3d921 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:19.705142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb0b9e3f-e262-43f0-af92-c80fadf3d921 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:19.705850 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb0b9e3f-e262-43f0-af92-c80fadf3d921 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:19.706896 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb0b9e3f-e262-43f0-af92-c80fadf3d921 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:19.707524 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fb0b9e3f-e262-43f0-af92-c80fadf3d921 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:19.757707 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f8a898de-ac58-4102-b99c-37e7d55d86ba tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:19.758336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f8a898de-ac58-4102-b99c-37e7d55d86ba tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:19.765273 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8a898de-ac58-4102-b99c-37e7d55d86ba tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:19.765762 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8a898de-ac58-4102-b99c-37e7d55d86ba tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:19.766403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8a898de-ac58-4102-b99c-37e7d55d86ba tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:19.767292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8a898de-ac58-4102-b99c-37e7d55d86ba tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:19.768087 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8a898de-ac58-4102-b99c-37e7d55d86ba tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:19.768518 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8a898de-ac58-4102-b99c-37e7d55d86ba tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:19.863921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fb0b9e3f-e262-43f0-af92-c80fadf3d921 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:19.873215 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fb0b9e3f-e262-43f0-af92-c80fadf3d921 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:19.874710 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fb0b9e3f-e262-43f0-af92-c80fadf3d921 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:19.875912 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fb0b9e3f-e262-43f0-af92-c80fadf3d921 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1752 microversion: 2.20 time: 0.183596 Sep 09 13:19:19.876476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 340/672] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:19 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:20.085878 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5fd19a0a-f7a6-46d8-9fce-223620a33248 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:20.086718 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5fd19a0a-f7a6-46d8-9fce-223620a33248 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:20.089808 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:20.095460 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fd19a0a-f7a6-46d8-9fce-223620a33248 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:20.096095 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fd19a0a-f7a6-46d8-9fce-223620a33248 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:20.096637 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fd19a0a-f7a6-46d8-9fce-223620a33248 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:20.097864 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fd19a0a-f7a6-46d8-9fce-223620a33248 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:20.098408 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fd19a0a-f7a6-46d8-9fce-223620a33248 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:20.098905 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5fd19a0a-f7a6-46d8-9fce-223620a33248 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:20.131140 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f8a898de-ac58-4102-b99c-37e7d55d86ba tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:20.140165 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f8a898de-ac58-4102-b99c-37e7d55d86ba tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.386568 Sep 09 13:19:20.143179 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 333/673] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:19 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:20.323472 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5fd19a0a-f7a6-46d8-9fce-223620a33248 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:20.331541 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5fd19a0a-f7a6-46d8-9fce-223620a33248 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.250136 Sep 09 13:19:20.332116 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 341/674] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:20 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:20.382230 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-faf02a3b-5b8d-4618-ab5a-7192ba6e52d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:20.383256 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-faf02a3b-5b8d-4618-ab5a-7192ba6e52d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:20.390660 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-faf02a3b-5b8d-4618-ab5a-7192ba6e52d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:20.391511 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-faf02a3b-5b8d-4618-ab5a-7192ba6e52d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:20.392047 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-faf02a3b-5b8d-4618-ab5a-7192ba6e52d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:20.393029 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-faf02a3b-5b8d-4618-ab5a-7192ba6e52d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:20.393683 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-faf02a3b-5b8d-4618-ab5a-7192ba6e52d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:20.394626 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-faf02a3b-5b8d-4618-ab5a-7192ba6e52d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:20.591371 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c28e6d84-fbe9-439d-83ec-57cf259d7463 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:20.592398 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c28e6d84-fbe9-439d-83ec-57cf259d7463 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:20.600956 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c28e6d84-fbe9-439d-83ec-57cf259d7463 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:20.601372 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c28e6d84-fbe9-439d-83ec-57cf259d7463 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:20.602188 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c28e6d84-fbe9-439d-83ec-57cf259d7463 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:20.602926 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c28e6d84-fbe9-439d-83ec-57cf259d7463 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:20.603455 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c28e6d84-fbe9-439d-83ec-57cf259d7463 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:20.603923 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c28e6d84-fbe9-439d-83ec-57cf259d7463 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:20.833231 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c28e6d84-fbe9-439d-83ec-57cf259d7463 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:20.842175 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c28e6d84-fbe9-439d-83ec-57cf259d7463 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1444 microversion: 2.1 time: 0.256243 Sep 09 13:19:20.843010 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 342/675] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:20 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1444 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:20.847773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-5609e465-a8c2-416e-a145-9358f524ccaa req-77899347-a563-4b0b-a9f4-90d5dd91d7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff665b2c-17b1-41cb-b909-b7dd0e9646bb", "tag": "d2757d75-8229-4684-94b8-28ebef9cfe6e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:20.857871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5609e465-a8c2-416e-a145-9358f524ccaa req-77899347-a563-4b0b-a9f4-90d5dd91d7e5 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:20.858333 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5609e465-a8c2-416e-a145-9358f524ccaa req-77899347-a563-4b0b-a9f4-90d5dd91d7e5 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:20.858925 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-5609e465-a8c2-416e-a145-9358f524ccaa req-77899347-a563-4b0b-a9f4-90d5dd91d7e5 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:20.865470 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-faf02a3b-5b8d-4618-ab5a-7192ba6e52d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:20.872601 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-5609e465-a8c2-416e-a145-9358f524ccaa req-77899347-a563-4b0b-a9f4-90d5dd91d7e5 service nova] Creating event network-changed:d2757d75-8229-4684-94b8-28ebef9cfe6e for instance ff665b2c-17b1-41cb-b909-b7dd0e9646bb on hv-cinder-83124 Sep 09 13:19:20.874617 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-faf02a3b-5b8d-4618-ab5a-7192ba6e52d9 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.498493 Sep 09 13:19:20.875313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 334/676] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:20 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:20.877727 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-5609e465-a8c2-416e-a145-9358f524ccaa req-77899347-a563-4b0b-a9f4-90d5dd91d7e5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033243 Sep 09 13:19:20.878680 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 343/677] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:20.880922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-862abc91-33b8-4c17-8e81-d39265f9f9e3 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:20.881760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-862abc91-33b8-4c17-8e81-d39265f9f9e3 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:20.887984 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-862abc91-33b8-4c17-8e81-d39265f9f9e3 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:20.888733 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-862abc91-33b8-4c17-8e81-d39265f9f9e3 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:20.890100 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-862abc91-33b8-4c17-8e81-d39265f9f9e3 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:20.891145 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-862abc91-33b8-4c17-8e81-d39265f9f9e3 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:20.891677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-862abc91-33b8-4c17-8e81-d39265f9f9e3 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:20.892184 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-862abc91-33b8-4c17-8e81-d39265f9f9e3 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:20.901811 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c342dd3a-9fd2-4242-937d-c88c2a37e206 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:20.902519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c342dd3a-9fd2-4242-937d-c88c2a37e206 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:20.908836 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c342dd3a-9fd2-4242-937d-c88c2a37e206 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:20.909327 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c342dd3a-9fd2-4242-937d-c88c2a37e206 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:20.909759 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c342dd3a-9fd2-4242-937d-c88c2a37e206 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:20.910645 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c342dd3a-9fd2-4242-937d-c88c2a37e206 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:20.911139 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c342dd3a-9fd2-4242-937d-c88c2a37e206 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:20.911562 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c342dd3a-9fd2-4242-937d-c88c2a37e206 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:21.045214 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c342dd3a-9fd2-4242-937d-c88c2a37e206 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:21.054618 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c342dd3a-9fd2-4242-937d-c88c2a37e206 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:21.056123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c342dd3a-9fd2-4242-937d-c88c2a37e206 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:21.057456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c342dd3a-9fd2-4242-937d-c88c2a37e206 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.160579 Sep 09 13:19:21.058045 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 344/678] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:20 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:19:21.113706 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-862abc91-33b8-4c17-8e81-d39265f9f9e3 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:21.122043 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-862abc91-33b8-4c17-8e81-d39265f9f9e3 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1444 microversion: 2.1 time: 0.245446 Sep 09 13:19:21.123071 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 335/679] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:20 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1444 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:21.163887 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-275a122d-37cd-4c3c-bb28-583049493fe2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:21.165156 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-275a122d-37cd-4c3c-bb28-583049493fe2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:21.205755 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-275a122d-37cd-4c3c-bb28-583049493fe2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:21.206276 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-275a122d-37cd-4c3c-bb28-583049493fe2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:21.207223 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-275a122d-37cd-4c3c-bb28-583049493fe2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:21.210152 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-275a122d-37cd-4c3c-bb28-583049493fe2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:21.210641 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-275a122d-37cd-4c3c-bb28-583049493fe2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:21.211198 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-275a122d-37cd-4c3c-bb28-583049493fe2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:21.358261 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-cc6af4e7-2fa1-40dd-bbe2-a7d4e847cce9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:21.359125 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-cc6af4e7-2fa1-40dd-bbe2-a7d4e847cce9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:21.366374 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cc6af4e7-2fa1-40dd-bbe2-a7d4e847cce9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:21.367134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cc6af4e7-2fa1-40dd-bbe2-a7d4e847cce9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:21.367786 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cc6af4e7-2fa1-40dd-bbe2-a7d4e847cce9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:21.369017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cc6af4e7-2fa1-40dd-bbe2-a7d4e847cce9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:21.371522 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cc6af4e7-2fa1-40dd-bbe2-a7d4e847cce9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:21.372199 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-cc6af4e7-2fa1-40dd-bbe2-a7d4e847cce9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:21.661953 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-cc6af4e7-2fa1-40dd-bbe2-a7d4e847cce9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:21.672271 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-cc6af4e7-2fa1-40dd-bbe2-a7d4e847cce9 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.320186 Sep 09 13:19:21.673194 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 336/680] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:21 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:21.860861 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-275a122d-37cd-4c3c-bb28-583049493fe2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:21.871978 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-275a122d-37cd-4c3c-bb28-583049493fe2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.712344 Sep 09 13:19:21.872737 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 345/681] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:21 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:21.898074 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e2dcce9e-5e47-476f-a327-cedbb1971608 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:21.898679 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e2dcce9e-5e47-476f-a327-cedbb1971608 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:21.906023 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2dcce9e-5e47-476f-a327-cedbb1971608 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:21.907167 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2dcce9e-5e47-476f-a327-cedbb1971608 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:21.907601 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2dcce9e-5e47-476f-a327-cedbb1971608 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:21.909947 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2dcce9e-5e47-476f-a327-cedbb1971608 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:21.910470 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2dcce9e-5e47-476f-a327-cedbb1971608 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:21.910900 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e2dcce9e-5e47-476f-a327-cedbb1971608 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:22.085631 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e07cfad8-6b9b-40f0-842e-396bd1f18448 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:22.086248 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e07cfad8-6b9b-40f0-842e-396bd1f18448 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:22.101835 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e07cfad8-6b9b-40f0-842e-396bd1f18448 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:22.102330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e07cfad8-6b9b-40f0-842e-396bd1f18448 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:22.102764 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e07cfad8-6b9b-40f0-842e-396bd1f18448 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:22.103496 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e07cfad8-6b9b-40f0-842e-396bd1f18448 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:22.104517 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e07cfad8-6b9b-40f0-842e-396bd1f18448 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:22.109634 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e07cfad8-6b9b-40f0-842e-396bd1f18448 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:22.140102 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e2dcce9e-5e47-476f-a327-cedbb1971608 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:22.149911 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e2dcce9e-5e47-476f-a327-cedbb1971608 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.255943 Sep 09 13:19:22.152144 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 337/682] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:21 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:22.159143 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-8e16afb5-7bdc-4870-bac8-9fdaaf97e2ca req-a1993bf3-b295-449f-8d95-a3cc2432fcfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d", "tag": "19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:22.176272 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-8e16afb5-7bdc-4870-bac8-9fdaaf97e2ca req-a1993bf3-b295-449f-8d95-a3cc2432fcfd service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:22.177632 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-8e16afb5-7bdc-4870-bac8-9fdaaf97e2ca req-a1993bf3-b295-449f-8d95-a3cc2432fcfd service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:22.178829 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-8e16afb5-7bdc-4870-bac8-9fdaaf97e2ca req-a1993bf3-b295-449f-8d95-a3cc2432fcfd service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:22.193051 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-8e16afb5-7bdc-4870-bac8-9fdaaf97e2ca req-a1993bf3-b295-449f-8d95-a3cc2432fcfd service nova] Creating event network-changed:19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f for instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d on hv-cinder-83124 Sep 09 13:19:22.199229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-8e16afb5-7bdc-4870-bac8-9fdaaf97e2ca req-a1993bf3-b295-449f-8d95-a3cc2432fcfd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045625 Sep 09 13:19:22.200335 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 338/683] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:22.394609 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e07cfad8-6b9b-40f0-842e-396bd1f18448 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:22.404813 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e07cfad8-6b9b-40f0-842e-396bd1f18448 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:22.406703 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e07cfad8-6b9b-40f0-842e-396bd1f18448 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:22.408719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e07cfad8-6b9b-40f0-842e-396bd1f18448 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.328640 Sep 09 13:19:22.409503 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 346/684] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:22 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:19:22.697366 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3b7c8b3f-dea2-40ae-b308-7bfcadd43050 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:22.698729 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3b7c8b3f-dea2-40ae-b308-7bfcadd43050 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:22.707735 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b7c8b3f-dea2-40ae-b308-7bfcadd43050 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:22.708780 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b7c8b3f-dea2-40ae-b308-7bfcadd43050 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:22.709462 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b7c8b3f-dea2-40ae-b308-7bfcadd43050 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:22.710625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b7c8b3f-dea2-40ae-b308-7bfcadd43050 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:22.711489 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b7c8b3f-dea2-40ae-b308-7bfcadd43050 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:22.712339 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3b7c8b3f-dea2-40ae-b308-7bfcadd43050 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:22.880566 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3b7c8b3f-dea2-40ae-b308-7bfcadd43050 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:22.889352 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3b7c8b3f-dea2-40ae-b308-7bfcadd43050 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.197623 Sep 09 13:19:22.891426 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 339/685] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:22 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:22.896562 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b28b00e2-8236-4e65-86fd-0c9f921b9698 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:22.897740 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b28b00e2-8236-4e65-86fd-0c9f921b9698 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:22.910766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b28b00e2-8236-4e65-86fd-0c9f921b9698 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:22.912174 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b28b00e2-8236-4e65-86fd-0c9f921b9698 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:22.912861 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b28b00e2-8236-4e65-86fd-0c9f921b9698 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:22.913898 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b28b00e2-8236-4e65-86fd-0c9f921b9698 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:22.914657 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b28b00e2-8236-4e65-86fd-0c9f921b9698 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:22.915256 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b28b00e2-8236-4e65-86fd-0c9f921b9698 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:23.183639 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e274826a-5f4d-4033-91ae-1d5f745b13f0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:23.186188 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e274826a-5f4d-4033-91ae-1d5f745b13f0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:23.188752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b28b00e2-8236-4e65-86fd-0c9f921b9698 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:23.194928 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e274826a-5f4d-4033-91ae-1d5f745b13f0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:23.196557 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e274826a-5f4d-4033-91ae-1d5f745b13f0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:23.197173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e274826a-5f4d-4033-91ae-1d5f745b13f0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:23.198470 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e274826a-5f4d-4033-91ae-1d5f745b13f0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:23.199879 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e274826a-5f4d-4033-91ae-1d5f745b13f0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:23.200799 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e274826a-5f4d-4033-91ae-1d5f745b13f0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:23.203701 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b28b00e2-8236-4e65-86fd-0c9f921b9698 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.310602 Sep 09 13:19:23.205918 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 347/686] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:22 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:23.364282 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e274826a-5f4d-4033-91ae-1d5f745b13f0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:23.375612 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e274826a-5f4d-4033-91ae-1d5f745b13f0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1733 microversion: 2.1 time: 0.199122 Sep 09 13:19:23.376817 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 340/687] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:23 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1733 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:23.437839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ef394448-b2f7-4905-9fa3-f116871cb220 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:23.438768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ef394448-b2f7-4905-9fa3-f116871cb220 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:23.446269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef394448-b2f7-4905-9fa3-f116871cb220 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:23.447018 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef394448-b2f7-4905-9fa3-f116871cb220 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:23.447772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef394448-b2f7-4905-9fa3-f116871cb220 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:23.448749 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef394448-b2f7-4905-9fa3-f116871cb220 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:23.450100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef394448-b2f7-4905-9fa3-f116871cb220 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:23.450746 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ef394448-b2f7-4905-9fa3-f116871cb220 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:23.456726 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:23.678043 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-76b3af4b-7d3c-4529-b460-12a265cb6465 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2014497034"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:23.678580 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-76b3af4b-7d3c-4529-b460-12a265cb6465 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:23.686211 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-76b3af4b-7d3c-4529-b460-12a265cb6465 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:23.686956 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-76b3af4b-7d3c-4529-b460-12a265cb6465 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:23.687913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-76b3af4b-7d3c-4529-b460-12a265cb6465 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:23.688922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-76b3af4b-7d3c-4529-b460-12a265cb6465 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:23.689586 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-76b3af4b-7d3c-4529-b460-12a265cb6465 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:23.690221 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-76b3af4b-7d3c-4529-b460-12a265cb6465 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:23.803293 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ef394448-b2f7-4905-9fa3-f116871cb220 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:23.813261 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ef394448-b2f7-4905-9fa3-f116871cb220 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:23.814740 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ef394448-b2f7-4905-9fa3-f116871cb220 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:23.816241 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ef394448-b2f7-4905-9fa3-f116871cb220 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.384045 Sep 09 13:19:23.825579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 348/688] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:23 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:23.876593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.network.security_group_api [None req-76b3af4b-7d3c-4529-b460-12a265cb6465 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Adding security group 981f98ce-99d4-4fe8-b47d-a3ede9d7ed16 to port 19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f Sep 09 13:19:23.913895 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c32c0f4-f1b8-4389-a63a-9ba2f23f2b4f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:23.915154 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3c32c0f4-f1b8-4389-a63a-9ba2f23f2b4f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:23.923441 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c32c0f4-f1b8-4389-a63a-9ba2f23f2b4f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:23.924202 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c32c0f4-f1b8-4389-a63a-9ba2f23f2b4f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:23.924660 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c32c0f4-f1b8-4389-a63a-9ba2f23f2b4f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:23.925357 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c32c0f4-f1b8-4389-a63a-9ba2f23f2b4f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:23.925815 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c32c0f4-f1b8-4389-a63a-9ba2f23f2b4f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:23.926241 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c32c0f4-f1b8-4389-a63a-9ba2f23f2b4f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:24.149754 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3c32c0f4-f1b8-4389-a63a-9ba2f23f2b4f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:24.158137 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c32c0f4-f1b8-4389-a63a-9ba2f23f2b4f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.248825 Sep 09 13:19:24.172307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 349/689] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:23 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:24.211830 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-76b3af4b-7d3c-4529-b460-12a265cb6465 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "POST /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/action" status: 202 len: 0 microversion: 2.1 time: 0.537698 Sep 09 13:19:24.214729 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 341/690] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 13:19:23 2022] POST /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:19:24.226998 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-92f3002d-ff69-4531-814e-0664574d3343 req-d55764c0-20e9-4839-9a0b-99e7c266caf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d", "tag": "19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:24.238072 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fa926cda-5e0e-481a-b6c5-140f20ba4488 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:24.240001 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fa926cda-5e0e-481a-b6c5-140f20ba4488 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:24.255165 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-92f3002d-ff69-4531-814e-0664574d3343 req-d55764c0-20e9-4839-9a0b-99e7c266caf7 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:24.256782 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-92f3002d-ff69-4531-814e-0664574d3343 req-d55764c0-20e9-4839-9a0b-99e7c266caf7 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:24.259019 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-92f3002d-ff69-4531-814e-0664574d3343 req-d55764c0-20e9-4839-9a0b-99e7c266caf7 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:24.263183 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa926cda-5e0e-481a-b6c5-140f20ba4488 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:24.264029 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa926cda-5e0e-481a-b6c5-140f20ba4488 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:24.264712 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa926cda-5e0e-481a-b6c5-140f20ba4488 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:24.265950 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa926cda-5e0e-481a-b6c5-140f20ba4488 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:24.266629 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa926cda-5e0e-481a-b6c5-140f20ba4488 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:24.267312 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fa926cda-5e0e-481a-b6c5-140f20ba4488 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:24.297252 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-92f3002d-ff69-4531-814e-0664574d3343 req-d55764c0-20e9-4839-9a0b-99e7c266caf7 service nova] Creating event network-changed:19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f for instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d on hv-cinder-83124 Sep 09 13:19:24.305928 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-92f3002d-ff69-4531-814e-0664574d3343 req-d55764c0-20e9-4839-9a0b-99e7c266caf7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085464 Sep 09 13:19:24.306536 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 342/691] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:19:24.312823 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b2496df7-cbba-412e-b89a-f6fa4823e435 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:24.313526 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b2496df7-cbba-412e-b89a-f6fa4823e435 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:24.320300 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2496df7-cbba-412e-b89a-f6fa4823e435 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:24.320790 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2496df7-cbba-412e-b89a-f6fa4823e435 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:24.321230 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2496df7-cbba-412e-b89a-f6fa4823e435 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:24.321948 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2496df7-cbba-412e-b89a-f6fa4823e435 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:24.322399 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2496df7-cbba-412e-b89a-f6fa4823e435 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:24.323995 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b2496df7-cbba-412e-b89a-f6fa4823e435 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:24.875308 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fa926cda-5e0e-481a-b6c5-140f20ba4488 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:24.892098 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fa926cda-5e0e-481a-b6c5-140f20ba4488 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1642 microversion: 2.1 time: 0.672250 Sep 09 13:19:24.893552 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 350/692] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:24 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1642 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:24.899988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-dcf58b33-3be0-4375-84c4-7c60d3c9943c req-f9c5d2e9-822e-496e-b995-19bd6000b94a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76473280-a8d1-4fed-a202-c9825247c44b", "tag": "48049b9e-9115-47c4-97e1-b44a8a86aef3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:24.923142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dcf58b33-3be0-4375-84c4-7c60d3c9943c req-f9c5d2e9-822e-496e-b995-19bd6000b94a service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:24.923794 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dcf58b33-3be0-4375-84c4-7c60d3c9943c req-f9c5d2e9-822e-496e-b995-19bd6000b94a service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:24.924046 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-dcf58b33-3be0-4375-84c4-7c60d3c9943c req-f9c5d2e9-822e-496e-b995-19bd6000b94a service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:24.936430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-dcf58b33-3be0-4375-84c4-7c60d3c9943c req-f9c5d2e9-822e-496e-b995-19bd6000b94a service nova] Creating event network-changed:48049b9e-9115-47c4-97e1-b44a8a86aef3 for instance 76473280-a8d1-4fed-a202-c9825247c44b on hv-cinder-83124 Sep 09 13:19:24.942046 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-dcf58b33-3be0-4375-84c4-7c60d3c9943c req-f9c5d2e9-822e-496e-b995-19bd6000b94a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046891 Sep 09 13:19:24.942986 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 351/693] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:24.948454 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-18ab20fb-e56f-4b0d-bb9b-c6a637d2ade8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:24.949384 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-18ab20fb-e56f-4b0d-bb9b-c6a637d2ade8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:24.955808 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18ab20fb-e56f-4b0d-bb9b-c6a637d2ade8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:24.956518 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18ab20fb-e56f-4b0d-bb9b-c6a637d2ade8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:24.957116 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18ab20fb-e56f-4b0d-bb9b-c6a637d2ade8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:24.958007 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18ab20fb-e56f-4b0d-bb9b-c6a637d2ade8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:24.958754 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18ab20fb-e56f-4b0d-bb9b-c6a637d2ade8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:24.959377 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18ab20fb-e56f-4b0d-bb9b-c6a637d2ade8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:25.022056 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:25.053156 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b2496df7-cbba-412e-b89a-f6fa4823e435 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:25.063172 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b2496df7-cbba-412e-b89a-f6fa4823e435 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.754687 Sep 09 13:19:25.076873 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 343/694] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:24 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:25.090412 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9422eca2-e69a-4ccf-ac52-985ca560d842 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:25.091042 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9422eca2-e69a-4ccf-ac52-985ca560d842 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:25.107113 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9422eca2-e69a-4ccf-ac52-985ca560d842 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:25.107848 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9422eca2-e69a-4ccf-ac52-985ca560d842 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:25.108435 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9422eca2-e69a-4ccf-ac52-985ca560d842 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:25.111044 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9422eca2-e69a-4ccf-ac52-985ca560d842 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:25.112438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9422eca2-e69a-4ccf-ac52-985ca560d842 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:25.113046 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9422eca2-e69a-4ccf-ac52-985ca560d842 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:25.179219 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=8 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:25.209875 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-18ab20fb-e56f-4b0d-bb9b-c6a637d2ade8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:25.219536 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-18ab20fb-e56f-4b0d-bb9b-c6a637d2ade8 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1713 microversion: 2.1 time: 0.275141 Sep 09 13:19:25.220113 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 352/695] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:24 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1713 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:25.225128 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-38db199d-8e58-4663-8d4b-b8462ec0a8c7 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:25.225920 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-38db199d-8e58-4663-8d4b-b8462ec0a8c7 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:25.234801 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38db199d-8e58-4663-8d4b-b8462ec0a8c7 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:25.235380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38db199d-8e58-4663-8d4b-b8462ec0a8c7 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:25.235822 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38db199d-8e58-4663-8d4b-b8462ec0a8c7 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:25.236517 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38db199d-8e58-4663-8d4b-b8462ec0a8c7 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:25.236969 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38db199d-8e58-4663-8d4b-b8462ec0a8c7 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:25.237417 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-38db199d-8e58-4663-8d4b-b8462ec0a8c7 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:25.299323 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9422eca2-e69a-4ccf-ac52-985ca560d842 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:25.309281 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9422eca2-e69a-4ccf-ac52-985ca560d842 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:25.310530 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9422eca2-e69a-4ccf-ac52-985ca560d842 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:25.312188 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9422eca2-e69a-4ccf-ac52-985ca560d842 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.233740 Sep 09 13:19:25.312759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 344/696] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:25 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:25.346647 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-febe0c44-361b-4f08-9460-6aad7e076007 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:25.347159 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-febe0c44-361b-4f08-9460-6aad7e076007 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:25.353210 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-febe0c44-361b-4f08-9460-6aad7e076007 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:25.353778 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-febe0c44-361b-4f08-9460-6aad7e076007 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:25.354962 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-febe0c44-361b-4f08-9460-6aad7e076007 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:25.355774 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-febe0c44-361b-4f08-9460-6aad7e076007 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:25.356256 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-febe0c44-361b-4f08-9460-6aad7e076007 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:25.356637 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-febe0c44-361b-4f08-9460-6aad7e076007 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:25.413758 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-38db199d-8e58-4663-8d4b-b8462ec0a8c7 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:25.422920 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-38db199d-8e58-4663-8d4b-b8462ec0a8c7 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.201272 Sep 09 13:19:25.439593 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 353/697] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:25 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:25.447075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-febe0c44-361b-4f08-9460-6aad7e076007 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] HTTP exception thrown: Cannot 'detach_volume' instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 while it is in vm_state rescued Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-febe0c44-361b-4f08-9460-6aad7e076007 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Request method failure captured: Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: DELETE /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-volume_attachments/47a7b876-b956-4805-a76b-ac86fdc63886 HTTP/1.1 Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxMaP5VQ9Fa4ImIgAfQPE2uyEKzPqrSzG7jDqHVKheNPr4YU7dLoJPAu1rRTBsxWJj2PugBC5JGZ6kf7tsaYSTWABRQuj-o4spLAESfpGmqV5VvqtmG6FoGDvekFdSvHcYXGJy8g3zxH-DAzraEBEuS_8Rx758zmWkj4bVIt3J4Dcs Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 1eedefa6b656409f902d158e77d94aa0 Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:19:25.449429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:19:25.450759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1eedefa6b656409f902d158e77d94aa0", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:19:25.450759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:19:25.450759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 1eedefa6b656409f902d158e77d94aa0 Sep 09 13:19:25.450759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:19:25.450759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-ServerRescueNegativeTestJSON-819143313-project Sep 09 13:19:25.450759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:19:25.450759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:19:25.450759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: 21700a3c2ff24fc6a3bb5db8bf283f5c Sep 09 13:19:25.450759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-ServerRescueNegativeTestJSON-819143313-project Sep 09 13:19:25.450759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:19:25.450759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Cannot 'detach_volume' instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 while it is in vm_state rescued Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'server_id': '4f8d3e22-93f3-4251-bbfc-8bd5c60cb875', 'id': '47a7b876-b956-4805-a76b-ac86fdc63886'} Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:19:25.451593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 while it is in vm_state rescued Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 while it is in vm_state rescued Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:19:25.453345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-febe0c44-361b-4f08-9460-6aad7e076007 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Returning 409 to user: Cannot 'detach_volume' instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 while it is in vm_state rescued {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:19:25.454313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-febe0c44-361b-4f08-9460-6aad7e076007 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-volume_attachments/47a7b876-b956-4805-a76b-ac86fdc63886" status: 409 len: 152 microversion: 2.1 time: 0.108149 Sep 09 13:19:25.454313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 345/698] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 13:19:25 2022] DELETE /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-volume_attachments/47a7b876-b956-4805-a76b-ac86fdc63886 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 09 13:19:25.461922 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1044d5d5-6bcf-48d1-b2b0-36a7ce3f692c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:25.462505 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1044d5d5-6bcf-48d1-b2b0-36a7ce3f692c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:25.465042 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:25.470816 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1044d5d5-6bcf-48d1-b2b0-36a7ce3f692c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:25.471338 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1044d5d5-6bcf-48d1-b2b0-36a7ce3f692c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:25.471772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1044d5d5-6bcf-48d1-b2b0-36a7ce3f692c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:25.472465 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1044d5d5-6bcf-48d1-b2b0-36a7ce3f692c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:25.472922 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1044d5d5-6bcf-48d1-b2b0-36a7ce3f692c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:25.473348 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1044d5d5-6bcf-48d1-b2b0-36a7ce3f692c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:25.542688 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1044d5d5-6bcf-48d1-b2b0-36a7ce3f692c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "POST /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/action" status: 202 len: 0 microversion: 2.1 time: 0.084821 Sep 09 13:19:25.546468 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 354/699] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 13:19:25 2022] POST /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:19:25.551464 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9799e759-ecfc-449b-a92c-ba2873c0e221 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:25.552074 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9799e759-ecfc-449b-a92c-ba2873c0e221 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:25.559269 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9799e759-ecfc-449b-a92c-ba2873c0e221 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:25.559872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9799e759-ecfc-449b-a92c-ba2873c0e221 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:25.560403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9799e759-ecfc-449b-a92c-ba2873c0e221 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:25.561174 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9799e759-ecfc-449b-a92c-ba2873c0e221 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:25.561704 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9799e759-ecfc-449b-a92c-ba2873c0e221 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:25.562200 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9799e759-ecfc-449b-a92c-ba2873c0e221 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:25.702298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9799e759-ecfc-449b-a92c-ba2873c0e221 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:25.710752 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9799e759-ecfc-449b-a92c-ba2873c0e221 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.163055 Sep 09 13:19:25.711451 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 346/700] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:25 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:26.087115 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:26.091887 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4836b783-a7e0-4ecb-ba9d-6d0cb9c100b5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:26.092626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4836b783-a7e0-4ecb-ba9d-6d0cb9c100b5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:26.099080 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4836b783-a7e0-4ecb-ba9d-6d0cb9c100b5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:26.099571 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4836b783-a7e0-4ecb-ba9d-6d0cb9c100b5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:26.100006 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4836b783-a7e0-4ecb-ba9d-6d0cb9c100b5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:26.100701 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4836b783-a7e0-4ecb-ba9d-6d0cb9c100b5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:26.101154 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4836b783-a7e0-4ecb-ba9d-6d0cb9c100b5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:26.101578 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4836b783-a7e0-4ecb-ba9d-6d0cb9c100b5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:26.341809 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d214aea1-7adb-4b8b-92f9-e1366d2ec631 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:26.343008 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d214aea1-7adb-4b8b-92f9-e1366d2ec631 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:26.355112 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d214aea1-7adb-4b8b-92f9-e1366d2ec631 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:26.355754 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d214aea1-7adb-4b8b-92f9-e1366d2ec631 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:26.356190 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d214aea1-7adb-4b8b-92f9-e1366d2ec631 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:26.362125 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d214aea1-7adb-4b8b-92f9-e1366d2ec631 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:26.362619 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d214aea1-7adb-4b8b-92f9-e1366d2ec631 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:26.363155 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d214aea1-7adb-4b8b-92f9-e1366d2ec631 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:26.455700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4836b783-a7e0-4ecb-ba9d-6d0cb9c100b5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:26.473836 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4836b783-a7e0-4ecb-ba9d-6d0cb9c100b5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.384574 Sep 09 13:19:26.475732 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 355/701] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:26 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:26.481920 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2b85a46e-49fe-4516-8e1e-065847e08b6f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:26.482834 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2b85a46e-49fe-4516-8e1e-065847e08b6f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:26.493753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b85a46e-49fe-4516-8e1e-065847e08b6f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:26.495544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b85a46e-49fe-4516-8e1e-065847e08b6f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:26.496335 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b85a46e-49fe-4516-8e1e-065847e08b6f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:26.497357 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b85a46e-49fe-4516-8e1e-065847e08b6f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:26.498031 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b85a46e-49fe-4516-8e1e-065847e08b6f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:26.498654 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2b85a46e-49fe-4516-8e1e-065847e08b6f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:26.716694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d214aea1-7adb-4b8b-92f9-e1366d2ec631 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:26.731291 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d214aea1-7adb-4b8b-92f9-e1366d2ec631 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:26.732831 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d214aea1-7adb-4b8b-92f9-e1366d2ec631 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:26.734075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d214aea1-7adb-4b8b-92f9-e1366d2ec631 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.397629 Sep 09 13:19:26.737359 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 347/702] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:26 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:26.742892 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-734c29c2-dcd9-423f-bd79-1771c73315fb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:26.746744 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-734c29c2-dcd9-423f-bd79-1771c73315fb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:26.757624 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-734c29c2-dcd9-423f-bd79-1771c73315fb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:26.758491 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-734c29c2-dcd9-423f-bd79-1771c73315fb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:26.759172 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-734c29c2-dcd9-423f-bd79-1771c73315fb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:26.760678 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-734c29c2-dcd9-423f-bd79-1771c73315fb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:26.761461 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-734c29c2-dcd9-423f-bd79-1771c73315fb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:26.762402 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-734c29c2-dcd9-423f-bd79-1771c73315fb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:26.901861 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2b85a46e-49fe-4516-8e1e-065847e08b6f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:26.911938 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2b85a46e-49fe-4516-8e1e-065847e08b6f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.434863 Sep 09 13:19:26.913072 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 356/703] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:26 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:27.034346 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-734c29c2-dcd9-423f-bd79-1771c73315fb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:27.045027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-734c29c2-dcd9-423f-bd79-1771c73315fb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.305818 Sep 09 13:19:27.045825 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 348/704] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:26 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:27.114383 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-af22055d-ba3f-448e-9a4f-4b1922334dc4 req-f40df5fb-4717-471a-ae63-88e8f42323d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68162eb9-cbe5-401b-bd53-8a1a715bb164", "name": "network-vif-plugged", "status": "completed", "tag": "0fdd18ec-bd72-455b-b76a-776cd528e722"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:27.126623 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-af22055d-ba3f-448e-9a4f-4b1922334dc4 req-f40df5fb-4717-471a-ae63-88e8f42323d3 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:27.127384 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-af22055d-ba3f-448e-9a4f-4b1922334dc4 req-f40df5fb-4717-471a-ae63-88e8f42323d3 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:27.127997 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-af22055d-ba3f-448e-9a4f-4b1922334dc4 req-f40df5fb-4717-471a-ae63-88e8f42323d3 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:27.142944 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-af22055d-ba3f-448e-9a4f-4b1922334dc4 req-f40df5fb-4717-471a-ae63-88e8f42323d3 service nova] Creating event network-vif-plugged:0fdd18ec-bd72-455b-b76a-776cd528e722 for instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 on hv-cinder-83124 Sep 09 13:19:27.153734 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-af22055d-ba3f-448e-9a4f-4b1922334dc4 req-f40df5fb-4717-471a-ae63-88e8f42323d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043209 Sep 09 13:19:27.158028 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 357/705] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:27.498454 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-94390fcd-0892-43ee-b235-4c601d5957e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:27.499084 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-94390fcd-0892-43ee-b235-4c601d5957e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:27.505473 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94390fcd-0892-43ee-b235-4c601d5957e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:27.505960 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94390fcd-0892-43ee-b235-4c601d5957e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:27.506398 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94390fcd-0892-43ee-b235-4c601d5957e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:27.507112 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94390fcd-0892-43ee-b235-4c601d5957e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:27.507570 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94390fcd-0892-43ee-b235-4c601d5957e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:27.508000 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-94390fcd-0892-43ee-b235-4c601d5957e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:27.512581 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:27.654558 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-94390fcd-0892-43ee-b235-4c601d5957e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:27.662392 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-94390fcd-0892-43ee-b235-4c601d5957e4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.168554 Sep 09 13:19:27.662959 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 349/706] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:27 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:27.770015 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1d6dbc99-f958-42c5-9044-e755fb2306be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:27.770650 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1d6dbc99-f958-42c5-9044-e755fb2306be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:27.776726 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d6dbc99-f958-42c5-9044-e755fb2306be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:27.777200 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d6dbc99-f958-42c5-9044-e755fb2306be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:27.777627 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d6dbc99-f958-42c5-9044-e755fb2306be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:27.778302 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d6dbc99-f958-42c5-9044-e755fb2306be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:27.778747 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d6dbc99-f958-42c5-9044-e755fb2306be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:27.779197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1d6dbc99-f958-42c5-9044-e755fb2306be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:27.924490 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1d6dbc99-f958-42c5-9044-e755fb2306be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:27.938757 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f544525a-d1f6-46ed-9627-8fecaf02898c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:27.939906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f544525a-d1f6-46ed-9627-8fecaf02898c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:27.950598 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f544525a-d1f6-46ed-9627-8fecaf02898c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:27.951423 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f544525a-d1f6-46ed-9627-8fecaf02898c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:27.952673 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f544525a-d1f6-46ed-9627-8fecaf02898c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:27.954241 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1d6dbc99-f958-42c5-9044-e755fb2306be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:27.955036 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f544525a-d1f6-46ed-9627-8fecaf02898c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:27.956293 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f544525a-d1f6-46ed-9627-8fecaf02898c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:27.957456 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f544525a-d1f6-46ed-9627-8fecaf02898c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:27.958715 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1d6dbc99-f958-42c5-9044-e755fb2306be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:27.962942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1d6dbc99-f958-42c5-9044-e755fb2306be tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.195424 Sep 09 13:19:27.964005 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 358/707] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:27 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:28.069883 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4380d13b-819a-46b1-97e0-56b13939bc17 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:28.071118 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4380d13b-819a-46b1-97e0-56b13939bc17 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:28.080455 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4380d13b-819a-46b1-97e0-56b13939bc17 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:28.081602 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4380d13b-819a-46b1-97e0-56b13939bc17 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:28.082317 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4380d13b-819a-46b1-97e0-56b13939bc17 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:28.083262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4380d13b-819a-46b1-97e0-56b13939bc17 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:28.083887 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4380d13b-819a-46b1-97e0-56b13939bc17 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:28.084471 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4380d13b-819a-46b1-97e0-56b13939bc17 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:28.106265 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f544525a-d1f6-46ed-9627-8fecaf02898c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:28.114510 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f544525a-d1f6-46ed-9627-8fecaf02898c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.179887 Sep 09 13:19:28.120406 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 350/708] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:27 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:28.234923 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4380d13b-819a-46b1-97e0-56b13939bc17 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:28.246421 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4380d13b-819a-46b1-97e0-56b13939bc17 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.180556 Sep 09 13:19:28.247592 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 359/709] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:28 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:28.687768 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ea8c7309-2515-4c4e-aed8-186f546221ab tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:28.689047 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ea8c7309-2515-4c4e-aed8-186f546221ab tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:28.696171 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea8c7309-2515-4c4e-aed8-186f546221ab tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:28.696937 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea8c7309-2515-4c4e-aed8-186f546221ab tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:28.697597 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea8c7309-2515-4c4e-aed8-186f546221ab tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:28.698895 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea8c7309-2515-4c4e-aed8-186f546221ab tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:28.699537 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea8c7309-2515-4c4e-aed8-186f546221ab tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:28.700121 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ea8c7309-2515-4c4e-aed8-186f546221ab tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:28.853040 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ea8c7309-2515-4c4e-aed8-186f546221ab tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:28.862036 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ea8c7309-2515-4c4e-aed8-186f546221ab tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.178017 Sep 09 13:19:28.862677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 351/710] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:28 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:28.990059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-de550204-4853-4564-ae3c-6beb12421778 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:28.990666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-de550204-4853-4564-ae3c-6beb12421778 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:28.997304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de550204-4853-4564-ae3c-6beb12421778 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:28.997812 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de550204-4853-4564-ae3c-6beb12421778 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:28.998238 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de550204-4853-4564-ae3c-6beb12421778 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:28.998936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de550204-4853-4564-ae3c-6beb12421778 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:28.999412 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de550204-4853-4564-ae3c-6beb12421778 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:28.999829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-de550204-4853-4564-ae3c-6beb12421778 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:29.143629 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-90533bcb-7372-48e0-89b1-2e022875a64d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:29.145476 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-90533bcb-7372-48e0-89b1-2e022875a64d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:29.157885 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90533bcb-7372-48e0-89b1-2e022875a64d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:29.158919 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90533bcb-7372-48e0-89b1-2e022875a64d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:29.159986 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90533bcb-7372-48e0-89b1-2e022875a64d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:29.160889 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90533bcb-7372-48e0-89b1-2e022875a64d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:29.161677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90533bcb-7372-48e0-89b1-2e022875a64d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:29.162363 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90533bcb-7372-48e0-89b1-2e022875a64d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:29.172732 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-de550204-4853-4564-ae3c-6beb12421778 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:29.187421 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-de550204-4853-4564-ae3c-6beb12421778 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:29.193574 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-de550204-4853-4564-ae3c-6beb12421778 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:29.200381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-de550204-4853-4564-ae3c-6beb12421778 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.211241 Sep 09 13:19:29.201213 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 360/711] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:28 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:29.273013 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1c81d59b-ddd3-465e-a075-267df39c49ae tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:29.273646 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1c81d59b-ddd3-465e-a075-267df39c49ae tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:29.280547 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c81d59b-ddd3-465e-a075-267df39c49ae tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:29.281165 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c81d59b-ddd3-465e-a075-267df39c49ae tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:29.281604 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c81d59b-ddd3-465e-a075-267df39c49ae tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:29.282373 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c81d59b-ddd3-465e-a075-267df39c49ae tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:29.282829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c81d59b-ddd3-465e-a075-267df39c49ae tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:29.283274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1c81d59b-ddd3-465e-a075-267df39c49ae tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:29.359603 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-90533bcb-7372-48e0-89b1-2e022875a64d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:29.367726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-90533bcb-7372-48e0-89b1-2e022875a64d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.229665 Sep 09 13:19:29.374457 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 352/712] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:29 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:29.455810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1c81d59b-ddd3-465e-a075-267df39c49ae tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:29.464719 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1c81d59b-ddd3-465e-a075-267df39c49ae tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.196026 Sep 09 13:19:29.465283 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 361/713] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:29 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:29.885104 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8faa7eab-49a0-44f1-82ad-4569268bac6a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:29.886526 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8faa7eab-49a0-44f1-82ad-4569268bac6a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:29.893274 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8faa7eab-49a0-44f1-82ad-4569268bac6a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:29.893757 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8faa7eab-49a0-44f1-82ad-4569268bac6a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:29.894190 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8faa7eab-49a0-44f1-82ad-4569268bac6a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:29.894912 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8faa7eab-49a0-44f1-82ad-4569268bac6a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:29.895397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8faa7eab-49a0-44f1-82ad-4569268bac6a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:29.895822 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8faa7eab-49a0-44f1-82ad-4569268bac6a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:30.044847 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8faa7eab-49a0-44f1-82ad-4569268bac6a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:30.052349 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8faa7eab-49a0-44f1-82ad-4569268bac6a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.171198 Sep 09 13:19:30.052904 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 353/714] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:29 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:30.228027 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8456ccbd-6f83-404f-8218-35848d32f296 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:30.229342 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8456ccbd-6f83-404f-8218-35848d32f296 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:30.235892 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8456ccbd-6f83-404f-8218-35848d32f296 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:30.236369 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8456ccbd-6f83-404f-8218-35848d32f296 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:30.236797 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8456ccbd-6f83-404f-8218-35848d32f296 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:30.237480 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8456ccbd-6f83-404f-8218-35848d32f296 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:30.237931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8456ccbd-6f83-404f-8218-35848d32f296 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:30.238352 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8456ccbd-6f83-404f-8218-35848d32f296 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:30.381352 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8456ccbd-6f83-404f-8218-35848d32f296 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:30.392605 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8456ccbd-6f83-404f-8218-35848d32f296 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:30.395704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8456ccbd-6f83-404f-8218-35848d32f296 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:30.397346 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8456ccbd-6f83-404f-8218-35848d32f296 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.173246 Sep 09 13:19:30.398418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 362/715] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:30 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:30.401008 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-314a169d-3b08-4d4a-9515-61a53e4e099d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:30.401883 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-314a169d-3b08-4d4a-9515-61a53e4e099d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:30.408685 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-314a169d-3b08-4d4a-9515-61a53e4e099d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:30.409829 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-314a169d-3b08-4d4a-9515-61a53e4e099d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:30.410665 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-314a169d-3b08-4d4a-9515-61a53e4e099d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:30.411709 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-314a169d-3b08-4d4a-9515-61a53e4e099d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:30.412388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-314a169d-3b08-4d4a-9515-61a53e4e099d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:30.413036 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-314a169d-3b08-4d4a-9515-61a53e4e099d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:30.488219 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-16c61787-f770-40f2-9755-6d50d6fdf013 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:30.488751 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-16c61787-f770-40f2-9755-6d50d6fdf013 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:30.495640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16c61787-f770-40f2-9755-6d50d6fdf013 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:30.496310 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16c61787-f770-40f2-9755-6d50d6fdf013 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:30.496557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16c61787-f770-40f2-9755-6d50d6fdf013 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:30.497306 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16c61787-f770-40f2-9755-6d50d6fdf013 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:30.497707 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16c61787-f770-40f2-9755-6d50d6fdf013 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:30.498132 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-16c61787-f770-40f2-9755-6d50d6fdf013 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:30.582608 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-314a169d-3b08-4d4a-9515-61a53e4e099d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:30.593051 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-314a169d-3b08-4d4a-9515-61a53e4e099d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.197234 Sep 09 13:19:30.594122 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 354/716] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:30 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:30.654187 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-16c61787-f770-40f2-9755-6d50d6fdf013 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:30.665359 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-16c61787-f770-40f2-9755-6d50d6fdf013 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.180564 Sep 09 13:19:30.680455 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 363/717] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:30 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:31.003471 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-007adecc-fd47-4ed7-8f71-ecd3e07a8b31 req-c7822c60-be11-4fef-996b-3bb9dad991c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff665b2c-17b1-41cb-b909-b7dd0e9646bb", "name": "network-vif-plugged", "status": "completed", "tag": "d2757d75-8229-4684-94b8-28ebef9cfe6e"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:31.017740 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-007adecc-fd47-4ed7-8f71-ecd3e07a8b31 req-c7822c60-be11-4fef-996b-3bb9dad991c1 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:31.018511 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-007adecc-fd47-4ed7-8f71-ecd3e07a8b31 req-c7822c60-be11-4fef-996b-3bb9dad991c1 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:31.019188 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-007adecc-fd47-4ed7-8f71-ecd3e07a8b31 req-c7822c60-be11-4fef-996b-3bb9dad991c1 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:31.033934 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-007adecc-fd47-4ed7-8f71-ecd3e07a8b31 req-c7822c60-be11-4fef-996b-3bb9dad991c1 service nova] Creating event network-vif-plugged:d2757d75-8229-4684-94b8-28ebef9cfe6e for instance ff665b2c-17b1-41cb-b909-b7dd0e9646bb on hv-cinder-83124 Sep 09 13:19:31.040135 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-007adecc-fd47-4ed7-8f71-ecd3e07a8b31 req-c7822c60-be11-4fef-996b-3bb9dad991c1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040408 Sep 09 13:19:31.041513 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 355/718] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:31.075782 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-73dc2768-586b-4267-ab21-112afe62df5b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:31.076330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-73dc2768-586b-4267-ab21-112afe62df5b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:31.089471 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73dc2768-586b-4267-ab21-112afe62df5b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:31.089959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73dc2768-586b-4267-ab21-112afe62df5b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:31.090386 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73dc2768-586b-4267-ab21-112afe62df5b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:31.091176 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73dc2768-586b-4267-ab21-112afe62df5b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:31.091631 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73dc2768-586b-4267-ab21-112afe62df5b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:31.092052 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-73dc2768-586b-4267-ab21-112afe62df5b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:31.242252 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-73dc2768-586b-4267-ab21-112afe62df5b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:31.250754 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-73dc2768-586b-4267-ab21-112afe62df5b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.179561 Sep 09 13:19:31.251343 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 364/719] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:31 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:31.426360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5b3c8bb9-0f44-4e10-9326-dd2557d6d7fc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:31.427118 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5b3c8bb9-0f44-4e10-9326-dd2557d6d7fc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:31.434088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b3c8bb9-0f44-4e10-9326-dd2557d6d7fc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:31.434678 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b3c8bb9-0f44-4e10-9326-dd2557d6d7fc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:31.435158 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b3c8bb9-0f44-4e10-9326-dd2557d6d7fc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:31.435841 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b3c8bb9-0f44-4e10-9326-dd2557d6d7fc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:31.436298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b3c8bb9-0f44-4e10-9326-dd2557d6d7fc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:31.436726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b3c8bb9-0f44-4e10-9326-dd2557d6d7fc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:31.623275 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6137c7aa-052b-4be6-a294-4cbec2f4fdb8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:31.626110 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6137c7aa-052b-4be6-a294-4cbec2f4fdb8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:31.633180 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6137c7aa-052b-4be6-a294-4cbec2f4fdb8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:31.633736 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6137c7aa-052b-4be6-a294-4cbec2f4fdb8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:31.634280 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6137c7aa-052b-4be6-a294-4cbec2f4fdb8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:31.635615 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6137c7aa-052b-4be6-a294-4cbec2f4fdb8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:31.636215 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6137c7aa-052b-4be6-a294-4cbec2f4fdb8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:31.636725 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6137c7aa-052b-4be6-a294-4cbec2f4fdb8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:31.639957 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5b3c8bb9-0f44-4e10-9326-dd2557d6d7fc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:31.641560 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:31.655023 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5b3c8bb9-0f44-4e10-9326-dd2557d6d7fc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:31.656659 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5b3c8bb9-0f44-4e10-9326-dd2557d6d7fc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:31.658107 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5b3c8bb9-0f44-4e10-9326-dd2557d6d7fc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.236099 Sep 09 13:19:31.658681 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 356/720] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:31 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:31.692886 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-965d3943-239e-4132-9680-758ebd685c5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:31.699138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-965d3943-239e-4132-9680-758ebd685c5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:31.705627 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-965d3943-239e-4132-9680-758ebd685c5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:31.706514 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-965d3943-239e-4132-9680-758ebd685c5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:31.707235 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-965d3943-239e-4132-9680-758ebd685c5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:31.708873 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-965d3943-239e-4132-9680-758ebd685c5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:31.709939 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-965d3943-239e-4132-9680-758ebd685c5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:31.710791 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-965d3943-239e-4132-9680-758ebd685c5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:31.808568 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6137c7aa-052b-4be6-a294-4cbec2f4fdb8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:31.820138 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6137c7aa-052b-4be6-a294-4cbec2f4fdb8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.207865 Sep 09 13:19:31.820914 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 365/721] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:31 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:31.865020 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-965d3943-239e-4132-9680-758ebd685c5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:31.874307 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-965d3943-239e-4132-9680-758ebd685c5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.185375 Sep 09 13:19:31.875075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 357/722] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:31 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:32.275503 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-eb7d7135-0433-4cfc-adcd-db394dc96508 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:32.277009 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-eb7d7135-0433-4cfc-adcd-db394dc96508 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:32.286066 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb7d7135-0433-4cfc-adcd-db394dc96508 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:32.286704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb7d7135-0433-4cfc-adcd-db394dc96508 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:32.287302 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb7d7135-0433-4cfc-adcd-db394dc96508 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:32.288275 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb7d7135-0433-4cfc-adcd-db394dc96508 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:32.288885 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb7d7135-0433-4cfc-adcd-db394dc96508 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:32.289449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-eb7d7135-0433-4cfc-adcd-db394dc96508 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:32.432836 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-eb7d7135-0433-4cfc-adcd-db394dc96508 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:32.440976 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-eb7d7135-0433-4cfc-adcd-db394dc96508 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.170634 Sep 09 13:19:32.441550 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 366/723] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:32 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:32.685282 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-aad2c913-62dc-48a2-a9e0-5028e384a4b6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:32.686149 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-aad2c913-62dc-48a2-a9e0-5028e384a4b6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:32.694260 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aad2c913-62dc-48a2-a9e0-5028e384a4b6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:32.694824 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aad2c913-62dc-48a2-a9e0-5028e384a4b6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:32.695413 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aad2c913-62dc-48a2-a9e0-5028e384a4b6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:32.696166 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aad2c913-62dc-48a2-a9e0-5028e384a4b6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:32.696851 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aad2c913-62dc-48a2-a9e0-5028e384a4b6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:32.697340 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aad2c913-62dc-48a2-a9e0-5028e384a4b6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:32.843327 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3aeb999d-badf-46b1-ba94-835a4abeccf8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:32.844119 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3aeb999d-badf-46b1-ba94-835a4abeccf8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:32.850395 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3aeb999d-badf-46b1-ba94-835a4abeccf8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:32.850894 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3aeb999d-badf-46b1-ba94-835a4abeccf8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:32.851381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3aeb999d-badf-46b1-ba94-835a4abeccf8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:32.852383 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3aeb999d-badf-46b1-ba94-835a4abeccf8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:32.852806 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3aeb999d-badf-46b1-ba94-835a4abeccf8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:32.853237 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3aeb999d-badf-46b1-ba94-835a4abeccf8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:32.865995 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-aad2c913-62dc-48a2-a9e0-5028e384a4b6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:32.875481 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-aad2c913-62dc-48a2-a9e0-5028e384a4b6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:32.876896 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-aad2c913-62dc-48a2-a9e0-5028e384a4b6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:32.878039 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-aad2c913-62dc-48a2-a9e0-5028e384a4b6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.197208 Sep 09 13:19:32.878601 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 358/724] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:32 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:32.905974 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0f11dce2-a8a5-438e-98ba-13ccb02a4b5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:32.906816 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0f11dce2-a8a5-438e-98ba-13ccb02a4b5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:32.914332 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f11dce2-a8a5-438e-98ba-13ccb02a4b5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:32.914836 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f11dce2-a8a5-438e-98ba-13ccb02a4b5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:32.915400 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f11dce2-a8a5-438e-98ba-13ccb02a4b5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:32.916759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f11dce2-a8a5-438e-98ba-13ccb02a4b5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:32.917406 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f11dce2-a8a5-438e-98ba-13ccb02a4b5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:32.918339 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f11dce2-a8a5-438e-98ba-13ccb02a4b5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:33.016834 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3aeb999d-badf-46b1-ba94-835a4abeccf8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:33.024672 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3aeb999d-badf-46b1-ba94-835a4abeccf8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.185483 Sep 09 13:19:33.025235 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 367/725] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:32 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:33.090290 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0f11dce2-a8a5-438e-98ba-13ccb02a4b5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:33.099253 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0f11dce2-a8a5-438e-98ba-13ccb02a4b5d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.200447 Sep 09 13:19:33.099846 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 359/726] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:32 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:33.465234 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-624a3b2e-a987-4265-8dd9-3f77278a277a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:33.465894 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-624a3b2e-a987-4265-8dd9-3f77278a277a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:33.472907 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-624a3b2e-a987-4265-8dd9-3f77278a277a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:33.473436 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-624a3b2e-a987-4265-8dd9-3f77278a277a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:33.473890 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-624a3b2e-a987-4265-8dd9-3f77278a277a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:33.475381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-624a3b2e-a987-4265-8dd9-3f77278a277a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:33.475852 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-624a3b2e-a987-4265-8dd9-3f77278a277a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:33.476478 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-624a3b2e-a987-4265-8dd9-3f77278a277a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:33.615620 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-624a3b2e-a987-4265-8dd9-3f77278a277a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:33.624084 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-624a3b2e-a987-4265-8dd9-3f77278a277a tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.163495 Sep 09 13:19:33.624647 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 368/727] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:33 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:33.909686 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-32414c25-54f4-4ae5-95d9-6b1db582560a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:33.910309 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-32414c25-54f4-4ae5-95d9-6b1db582560a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:33.917480 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-32414c25-54f4-4ae5-95d9-6b1db582560a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:33.917963 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-32414c25-54f4-4ae5-95d9-6b1db582560a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:33.918401 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-32414c25-54f4-4ae5-95d9-6b1db582560a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:33.919112 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-32414c25-54f4-4ae5-95d9-6b1db582560a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:33.919570 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-32414c25-54f4-4ae5-95d9-6b1db582560a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:33.919998 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-32414c25-54f4-4ae5-95d9-6b1db582560a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:34.050827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f2028b49-b89b-4240-b091-b2e8d6a3260c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:34.051700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f2028b49-b89b-4240-b091-b2e8d6a3260c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:34.058315 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2028b49-b89b-4240-b091-b2e8d6a3260c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:34.058944 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2028b49-b89b-4240-b091-b2e8d6a3260c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:34.059408 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2028b49-b89b-4240-b091-b2e8d6a3260c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:34.060098 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2028b49-b89b-4240-b091-b2e8d6a3260c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:34.060545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2028b49-b89b-4240-b091-b2e8d6a3260c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:34.060960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f2028b49-b89b-4240-b091-b2e8d6a3260c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:34.066787 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-32414c25-54f4-4ae5-95d9-6b1db582560a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:34.076141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-32414c25-54f4-4ae5-95d9-6b1db582560a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:34.077575 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-32414c25-54f4-4ae5-95d9-6b1db582560a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:34.078723 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-32414c25-54f4-4ae5-95d9-6b1db582560a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.172922 Sep 09 13:19:34.079313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 360/728] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:33 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:34.124776 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f46afd2d-4743-485d-85bb-04848908dabf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:34.125661 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f46afd2d-4743-485d-85bb-04848908dabf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:34.132275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f46afd2d-4743-485d-85bb-04848908dabf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:34.132761 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f46afd2d-4743-485d-85bb-04848908dabf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:34.133261 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f46afd2d-4743-485d-85bb-04848908dabf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:34.133993 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f46afd2d-4743-485d-85bb-04848908dabf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:34.134453 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f46afd2d-4743-485d-85bb-04848908dabf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:34.134992 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f46afd2d-4743-485d-85bb-04848908dabf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:34.220429 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f2028b49-b89b-4240-b091-b2e8d6a3260c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:34.227983 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f2028b49-b89b-4240-b091-b2e8d6a3260c tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.183282 Sep 09 13:19:34.228752 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 369/729] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:34 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:34.290269 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f46afd2d-4743-485d-85bb-04848908dabf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:34.299393 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f46afd2d-4743-485d-85bb-04848908dabf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.178681 Sep 09 13:19:34.300096 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 361/730] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:34 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:34.647570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-738cd6a5-050a-4f8e-ba1e-2a1a465329eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:34.648541 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-738cd6a5-050a-4f8e-ba1e-2a1a465329eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:34.655597 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-738cd6a5-050a-4f8e-ba1e-2a1a465329eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:34.656253 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-738cd6a5-050a-4f8e-ba1e-2a1a465329eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:34.656744 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-738cd6a5-050a-4f8e-ba1e-2a1a465329eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:34.657520 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-738cd6a5-050a-4f8e-ba1e-2a1a465329eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:34.657990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-738cd6a5-050a-4f8e-ba1e-2a1a465329eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:34.658549 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-738cd6a5-050a-4f8e-ba1e-2a1a465329eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:34.811575 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-738cd6a5-050a-4f8e-ba1e-2a1a465329eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:34.820522 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-738cd6a5-050a-4f8e-ba1e-2a1a465329eb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.176771 Sep 09 13:19:34.821311 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 370/731] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:34 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:35.106179 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a1085624-5daa-4eeb-87f4-659ce2dd28b5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:35.106799 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a1085624-5daa-4eeb-87f4-659ce2dd28b5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:35.114353 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1085624-5daa-4eeb-87f4-659ce2dd28b5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:35.114982 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1085624-5daa-4eeb-87f4-659ce2dd28b5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:35.115458 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1085624-5daa-4eeb-87f4-659ce2dd28b5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:35.116323 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1085624-5daa-4eeb-87f4-659ce2dd28b5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:35.116782 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1085624-5daa-4eeb-87f4-659ce2dd28b5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:35.117343 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1085624-5daa-4eeb-87f4-659ce2dd28b5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:35.250672 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14bf2947-807f-4f20-8d93-e945b9cf07e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:35.251261 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a1085624-5daa-4eeb-87f4-659ce2dd28b5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:35.251398 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-14bf2947-807f-4f20-8d93-e945b9cf07e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:35.257371 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14bf2947-807f-4f20-8d93-e945b9cf07e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:35.257859 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14bf2947-807f-4f20-8d93-e945b9cf07e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:35.258330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14bf2947-807f-4f20-8d93-e945b9cf07e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:35.259695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14bf2947-807f-4f20-8d93-e945b9cf07e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:35.259695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14bf2947-807f-4f20-8d93-e945b9cf07e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:35.259947 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14bf2947-807f-4f20-8d93-e945b9cf07e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:35.260104 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a1085624-5daa-4eeb-87f4-659ce2dd28b5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:35.261605 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a1085624-5daa-4eeb-87f4-659ce2dd28b5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:35.262770 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a1085624-5daa-4eeb-87f4-659ce2dd28b5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.162545 Sep 09 13:19:35.263545 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 362/732] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:35 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:35.324663 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4c453d00-e3a9-49c6-94b1-ff28649b6ce0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:35.325317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4c453d00-e3a9-49c6-94b1-ff28649b6ce0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:35.331785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4c453d00-e3a9-49c6-94b1-ff28649b6ce0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:35.332281 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4c453d00-e3a9-49c6-94b1-ff28649b6ce0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:35.332717 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4c453d00-e3a9-49c6-94b1-ff28649b6ce0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:35.334686 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4c453d00-e3a9-49c6-94b1-ff28649b6ce0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:35.334968 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4c453d00-e3a9-49c6-94b1-ff28649b6ce0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:35.335433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4c453d00-e3a9-49c6-94b1-ff28649b6ce0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:35.425369 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-14bf2947-807f-4f20-8d93-e945b9cf07e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:35.435079 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14bf2947-807f-4f20-8d93-e945b9cf07e3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.188051 Sep 09 13:19:35.440151 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 371/733] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:35 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:35.481627 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4c453d00-e3a9-49c6-94b1-ff28649b6ce0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:35.490214 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4c453d00-e3a9-49c6-94b1-ff28649b6ce0 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.170372 Sep 09 13:19:35.490985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 363/734] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:35 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:35.845238 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-491535af-b3c3-4d66-9ae4-d9d7893648cb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:35.846351 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-491535af-b3c3-4d66-9ae4-d9d7893648cb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:35.856010 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-491535af-b3c3-4d66-9ae4-d9d7893648cb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:35.856839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-491535af-b3c3-4d66-9ae4-d9d7893648cb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:35.857551 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-491535af-b3c3-4d66-9ae4-d9d7893648cb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:35.858511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-491535af-b3c3-4d66-9ae4-d9d7893648cb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:35.859417 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-491535af-b3c3-4d66-9ae4-d9d7893648cb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:35.860077 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-491535af-b3c3-4d66-9ae4-d9d7893648cb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:36.005885 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-491535af-b3c3-4d66-9ae4-d9d7893648cb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:36.016123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-491535af-b3c3-4d66-9ae4-d9d7893648cb tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.175947 Sep 09 13:19:36.027892 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 372/735] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:35 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:36.287990 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2c976c5e-aa24-43f0-a3c5-aa2c5d355270 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:36.288637 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2c976c5e-aa24-43f0-a3c5-aa2c5d355270 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:36.297355 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c976c5e-aa24-43f0-a3c5-aa2c5d355270 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:36.297845 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c976c5e-aa24-43f0-a3c5-aa2c5d355270 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:36.298280 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c976c5e-aa24-43f0-a3c5-aa2c5d355270 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:36.298982 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c976c5e-aa24-43f0-a3c5-aa2c5d355270 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:36.299525 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c976c5e-aa24-43f0-a3c5-aa2c5d355270 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:36.299982 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2c976c5e-aa24-43f0-a3c5-aa2c5d355270 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:36.442840 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2c976c5e-aa24-43f0-a3c5-aa2c5d355270 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:36.452968 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2c976c5e-aa24-43f0-a3c5-aa2c5d355270 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:36.454770 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2c976c5e-aa24-43f0-a3c5-aa2c5d355270 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:36.456705 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2c976c5e-aa24-43f0-a3c5-aa2c5d355270 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.172413 Sep 09 13:19:36.471078 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-51ca36df-0e1e-43ba-9c24-b7a337466f71 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:36.471078 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-51ca36df-0e1e-43ba-9c24-b7a337466f71 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:36.471078 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51ca36df-0e1e-43ba-9c24-b7a337466f71 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:36.471078 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51ca36df-0e1e-43ba-9c24-b7a337466f71 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:36.471944 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51ca36df-0e1e-43ba-9c24-b7a337466f71 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:36.471944 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51ca36df-0e1e-43ba-9c24-b7a337466f71 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:36.471944 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51ca36df-0e1e-43ba-9c24-b7a337466f71 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:36.471944 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-51ca36df-0e1e-43ba-9c24-b7a337466f71 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:36.472872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 364/736] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:36 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:36.516132 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1672a0c8-cbfd-4349-9f78-da83e73d74f4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:36.516968 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1672a0c8-cbfd-4349-9f78-da83e73d74f4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:36.522965 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1672a0c8-cbfd-4349-9f78-da83e73d74f4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:36.523481 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1672a0c8-cbfd-4349-9f78-da83e73d74f4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:36.523910 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1672a0c8-cbfd-4349-9f78-da83e73d74f4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:36.524593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1672a0c8-cbfd-4349-9f78-da83e73d74f4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:36.525039 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1672a0c8-cbfd-4349-9f78-da83e73d74f4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:36.525489 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1672a0c8-cbfd-4349-9f78-da83e73d74f4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:36.613625 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-51ca36df-0e1e-43ba-9c24-b7a337466f71 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:36.622451 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-51ca36df-0e1e-43ba-9c24-b7a337466f71 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.168561 Sep 09 13:19:36.623286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 373/737] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:36 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:36.676262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1672a0c8-cbfd-4349-9f78-da83e73d74f4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:36.685038 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1672a0c8-cbfd-4349-9f78-da83e73d74f4 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.172892 Sep 09 13:19:36.685589 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 365/738] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:36 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:37.042375 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fcc6df4c-b3e8-41fd-bc17-7d5e170c75dd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:37.042978 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fcc6df4c-b3e8-41fd-bc17-7d5e170c75dd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:37.049371 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcc6df4c-b3e8-41fd-bc17-7d5e170c75dd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:37.049840 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcc6df4c-b3e8-41fd-bc17-7d5e170c75dd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:37.050375 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcc6df4c-b3e8-41fd-bc17-7d5e170c75dd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:37.051350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcc6df4c-b3e8-41fd-bc17-7d5e170c75dd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:37.051811 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcc6df4c-b3e8-41fd-bc17-7d5e170c75dd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:37.052228 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fcc6df4c-b3e8-41fd-bc17-7d5e170c75dd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:37.184842 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fcc6df4c-b3e8-41fd-bc17-7d5e170c75dd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:37.192386 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fcc6df4c-b3e8-41fd-bc17-7d5e170c75dd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.154558 Sep 09 13:19:37.192945 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 374/739] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:37 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:37.489684 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1a69d8fd-485f-44c8-9cbb-c4afc016a3e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:37.490741 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1a69d8fd-485f-44c8-9cbb-c4afc016a3e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:37.497631 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a69d8fd-485f-44c8-9cbb-c4afc016a3e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:37.498110 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a69d8fd-485f-44c8-9cbb-c4afc016a3e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:37.498538 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a69d8fd-485f-44c8-9cbb-c4afc016a3e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:37.499257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a69d8fd-485f-44c8-9cbb-c4afc016a3e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:37.499704 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a69d8fd-485f-44c8-9cbb-c4afc016a3e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:37.500122 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1a69d8fd-485f-44c8-9cbb-c4afc016a3e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:37.520282 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:37.647511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ea3e58b1-afa3-471e-9b97-bb95a47f6c41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:37.648257 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ea3e58b1-afa3-471e-9b97-bb95a47f6c41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:37.655453 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea3e58b1-afa3-471e-9b97-bb95a47f6c41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:37.656020 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea3e58b1-afa3-471e-9b97-bb95a47f6c41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:37.656547 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea3e58b1-afa3-471e-9b97-bb95a47f6c41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:37.657347 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea3e58b1-afa3-471e-9b97-bb95a47f6c41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:37.657834 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea3e58b1-afa3-471e-9b97-bb95a47f6c41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:37.658326 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ea3e58b1-afa3-471e-9b97-bb95a47f6c41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:37.659732 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1a69d8fd-485f-44c8-9cbb-c4afc016a3e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:37.669261 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1a69d8fd-485f-44c8-9cbb-c4afc016a3e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:37.670823 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1a69d8fd-485f-44c8-9cbb-c4afc016a3e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:37.672041 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1a69d8fd-485f-44c8-9cbb-c4afc016a3e4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.186296 Sep 09 13:19:37.672609 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 366/740] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:37 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:37.709289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4e11c133-0786-4f88-8c10-812ca84a9eba tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:37.710280 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4e11c133-0786-4f88-8c10-812ca84a9eba tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:37.718352 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e11c133-0786-4f88-8c10-812ca84a9eba tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:37.718842 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e11c133-0786-4f88-8c10-812ca84a9eba tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:37.719298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e11c133-0786-4f88-8c10-812ca84a9eba tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:37.719995 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e11c133-0786-4f88-8c10-812ca84a9eba tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:37.720445 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e11c133-0786-4f88-8c10-812ca84a9eba tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:37.720865 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e11c133-0786-4f88-8c10-812ca84a9eba tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:37.816750 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ea3e58b1-afa3-471e-9b97-bb95a47f6c41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:37.826892 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ea3e58b1-afa3-471e-9b97-bb95a47f6c41 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.182636 Sep 09 13:19:37.827103 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 375/741] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:37 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:37.866266 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4e11c133-0786-4f88-8c10-812ca84a9eba tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:37.875513 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4e11c133-0786-4f88-8c10-812ca84a9eba tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.170280 Sep 09 13:19:37.876093 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 367/742] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:37 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:38.215079 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c4def1fd-f133-4ca3-af07-09d16d777623 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:38.215696 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c4def1fd-f133-4ca3-af07-09d16d777623 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:38.222143 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4def1fd-f133-4ca3-af07-09d16d777623 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:38.222618 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4def1fd-f133-4ca3-af07-09d16d777623 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:38.223074 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4def1fd-f133-4ca3-af07-09d16d777623 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:38.223753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4def1fd-f133-4ca3-af07-09d16d777623 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:38.224204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4def1fd-f133-4ca3-af07-09d16d777623 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:38.224649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c4def1fd-f133-4ca3-af07-09d16d777623 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:38.360871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c4def1fd-f133-4ca3-af07-09d16d777623 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:38.368424 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c4def1fd-f133-4ca3-af07-09d16d777623 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.157432 Sep 09 13:19:38.368992 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 376/743] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:38 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:38.698648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-92be6f9d-f968-4c94-934b-340d27944bbd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:38.699279 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-92be6f9d-f968-4c94-934b-340d27944bbd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:38.706092 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92be6f9d-f968-4c94-934b-340d27944bbd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:38.706642 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92be6f9d-f968-4c94-934b-340d27944bbd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:38.707197 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92be6f9d-f968-4c94-934b-340d27944bbd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:38.707774 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92be6f9d-f968-4c94-934b-340d27944bbd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:38.708221 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92be6f9d-f968-4c94-934b-340d27944bbd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:38.708717 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92be6f9d-f968-4c94-934b-340d27944bbd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:38.849874 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5546b03a-ecbe-488d-8d8e-8f0040453ed3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:38.850567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5546b03a-ecbe-488d-8d8e-8f0040453ed3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:38.858741 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5546b03a-ecbe-488d-8d8e-8f0040453ed3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:38.859500 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5546b03a-ecbe-488d-8d8e-8f0040453ed3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:38.860114 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5546b03a-ecbe-488d-8d8e-8f0040453ed3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:38.860941 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5546b03a-ecbe-488d-8d8e-8f0040453ed3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:38.861655 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5546b03a-ecbe-488d-8d8e-8f0040453ed3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:38.862243 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5546b03a-ecbe-488d-8d8e-8f0040453ed3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:38.937990 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-92be6f9d-f968-4c94-934b-340d27944bbd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:38.948244 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-92be6f9d-f968-4c94-934b-340d27944bbd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:38.949740 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-92be6f9d-f968-4c94-934b-340d27944bbd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:38.950913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-92be6f9d-f968-4c94-934b-340d27944bbd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.257240 Sep 09 13:19:38.951515 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 368/744] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:38 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:38.956003 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ab53a0e9-72ef-4e69-b67c-d306e30fa048 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:38.956602 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ab53a0e9-72ef-4e69-b67c-d306e30fa048 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:38.962722 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab53a0e9-72ef-4e69-b67c-d306e30fa048 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:38.964125 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab53a0e9-72ef-4e69-b67c-d306e30fa048 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:38.964573 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab53a0e9-72ef-4e69-b67c-d306e30fa048 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:38.965275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab53a0e9-72ef-4e69-b67c-d306e30fa048 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:38.965900 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab53a0e9-72ef-4e69-b67c-d306e30fa048 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:38.966330 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ab53a0e9-72ef-4e69-b67c-d306e30fa048 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:39.017099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5546b03a-ecbe-488d-8d8e-8f0040453ed3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:39.024740 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5546b03a-ecbe-488d-8d8e-8f0040453ed3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.178822 Sep 09 13:19:39.025492 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 377/745] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:38 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:39.095545 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ab53a0e9-72ef-4e69-b67c-d306e30fa048 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:39.104202 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ab53a0e9-72ef-4e69-b67c-d306e30fa048 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.151200 Sep 09 13:19:39.104790 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 369/746] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:38 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:39.391018 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c8767804-324c-4dd1-a4a5-5056ff2a4127 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:39.391669 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c8767804-324c-4dd1-a4a5-5056ff2a4127 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:39.398123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8767804-324c-4dd1-a4a5-5056ff2a4127 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:39.398607 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8767804-324c-4dd1-a4a5-5056ff2a4127 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:39.399044 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8767804-324c-4dd1-a4a5-5056ff2a4127 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:39.399758 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8767804-324c-4dd1-a4a5-5056ff2a4127 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:39.400215 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8767804-324c-4dd1-a4a5-5056ff2a4127 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:39.401218 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c8767804-324c-4dd1-a4a5-5056ff2a4127 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:39.732083 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c8767804-324c-4dd1-a4a5-5056ff2a4127 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:39.739641 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c8767804-324c-4dd1-a4a5-5056ff2a4127 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.352459 Sep 09 13:19:39.740197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 378/747] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:39 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:39.977848 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f4a74309-acc0-4afe-98e2-d56843b2c2b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:39.978382 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f4a74309-acc0-4afe-98e2-d56843b2c2b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:39.985008 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4a74309-acc0-4afe-98e2-d56843b2c2b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:39.985490 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4a74309-acc0-4afe-98e2-d56843b2c2b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:39.985930 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4a74309-acc0-4afe-98e2-d56843b2c2b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:39.986618 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4a74309-acc0-4afe-98e2-d56843b2c2b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:39.987090 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4a74309-acc0-4afe-98e2-d56843b2c2b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:39.987520 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f4a74309-acc0-4afe-98e2-d56843b2c2b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:40.047808 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a1719697-805a-4457-9231-f9fa4639841f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:40.048405 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a1719697-805a-4457-9231-f9fa4639841f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:40.054243 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1719697-805a-4457-9231-f9fa4639841f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:40.054728 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1719697-805a-4457-9231-f9fa4639841f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:40.055183 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1719697-805a-4457-9231-f9fa4639841f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:40.056483 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1719697-805a-4457-9231-f9fa4639841f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:40.057500 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1719697-805a-4457-9231-f9fa4639841f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:40.058260 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a1719697-805a-4457-9231-f9fa4639841f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:40.128971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f4a74309-acc0-4afe-98e2-d56843b2c2b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:40.138144 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f4a74309-acc0-4afe-98e2-d56843b2c2b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:40.139627 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f4a74309-acc0-4afe-98e2-d56843b2c2b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:40.140796 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f4a74309-acc0-4afe-98e2-d56843b2c2b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.166931 Sep 09 13:19:40.141367 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 370/748] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:39 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:40.163910 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-252e7a4f-6685-496f-a67e-24ca16fccd6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:40.164527 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-252e7a4f-6685-496f-a67e-24ca16fccd6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:40.170944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-252e7a4f-6685-496f-a67e-24ca16fccd6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:40.171472 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-252e7a4f-6685-496f-a67e-24ca16fccd6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:40.171915 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-252e7a4f-6685-496f-a67e-24ca16fccd6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:40.172609 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-252e7a4f-6685-496f-a67e-24ca16fccd6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:40.173066 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-252e7a4f-6685-496f-a67e-24ca16fccd6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:40.173491 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-252e7a4f-6685-496f-a67e-24ca16fccd6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:40.304816 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-252e7a4f-6685-496f-a67e-24ca16fccd6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:40.313970 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-252e7a4f-6685-496f-a67e-24ca16fccd6f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.153821 Sep 09 13:19:40.314575 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 371/749] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:40 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:40.319444 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a1719697-805a-4457-9231-f9fa4639841f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:40.327359 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a1719697-805a-4457-9231-f9fa4639841f tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.283560 Sep 09 13:19:40.327925 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 379/750] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:40 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:40.762565 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a85fc990-ce86-49c7-ba8b-ddd47c264c41 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:40.763210 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a85fc990-ce86-49c7-ba8b-ddd47c264c41 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:40.769106 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a85fc990-ce86-49c7-ba8b-ddd47c264c41 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:40.769582 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a85fc990-ce86-49c7-ba8b-ddd47c264c41 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:40.770011 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a85fc990-ce86-49c7-ba8b-ddd47c264c41 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:40.770687 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a85fc990-ce86-49c7-ba8b-ddd47c264c41 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:40.771160 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a85fc990-ce86-49c7-ba8b-ddd47c264c41 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:40.771579 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a85fc990-ce86-49c7-ba8b-ddd47c264c41 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:40.898218 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a85fc990-ce86-49c7-ba8b-ddd47c264c41 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:40.905995 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a85fc990-ce86-49c7-ba8b-ddd47c264c41 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.148190 Sep 09 13:19:40.906566 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 372/751] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:40 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:41.166770 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d438e5f9-ce35-44a4-8b8c-f1498643f129 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:41.167363 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d438e5f9-ce35-44a4-8b8c-f1498643f129 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:41.174384 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d438e5f9-ce35-44a4-8b8c-f1498643f129 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:41.174875 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d438e5f9-ce35-44a4-8b8c-f1498643f129 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:41.175446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d438e5f9-ce35-44a4-8b8c-f1498643f129 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:41.176131 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d438e5f9-ce35-44a4-8b8c-f1498643f129 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:41.176583 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d438e5f9-ce35-44a4-8b8c-f1498643f129 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:41.177002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d438e5f9-ce35-44a4-8b8c-f1498643f129 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:41.336649 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c411c5ab-24bb-4105-8d8f-4fa31463aab3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:41.337257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c411c5ab-24bb-4105-8d8f-4fa31463aab3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:41.343930 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c411c5ab-24bb-4105-8d8f-4fa31463aab3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:41.344417 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c411c5ab-24bb-4105-8d8f-4fa31463aab3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:41.344993 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c411c5ab-24bb-4105-8d8f-4fa31463aab3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:41.345874 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c411c5ab-24bb-4105-8d8f-4fa31463aab3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:41.346397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c411c5ab-24bb-4105-8d8f-4fa31463aab3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:41.346830 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c411c5ab-24bb-4105-8d8f-4fa31463aab3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:41.352300 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d438e5f9-ce35-44a4-8b8c-f1498643f129 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:41.361826 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d438e5f9-ce35-44a4-8b8c-f1498643f129 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:41.363336 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d438e5f9-ce35-44a4-8b8c-f1498643f129 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:41.364492 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d438e5f9-ce35-44a4-8b8c-f1498643f129 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.201703 Sep 09 13:19:41.365052 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 380/752] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:41 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:41.369706 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e1b39c8c-5d26-4830-8deb-d015a93a5ac1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:41.370867 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e1b39c8c-5d26-4830-8deb-d015a93a5ac1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:41.376547 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1b39c8c-5d26-4830-8deb-d015a93a5ac1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:41.377035 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1b39c8c-5d26-4830-8deb-d015a93a5ac1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:41.377472 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1b39c8c-5d26-4830-8deb-d015a93a5ac1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:41.378167 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1b39c8c-5d26-4830-8deb-d015a93a5ac1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:41.378624 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1b39c8c-5d26-4830-8deb-d015a93a5ac1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:41.379171 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e1b39c8c-5d26-4830-8deb-d015a93a5ac1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:41.480170 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c411c5ab-24bb-4105-8d8f-4fa31463aab3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:41.488298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c411c5ab-24bb-4105-8d8f-4fa31463aab3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.155490 Sep 09 13:19:41.488866 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 373/753] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:41 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:41.515120 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e1b39c8c-5d26-4830-8deb-d015a93a5ac1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:41.518427 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=100 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:41.523478 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e1b39c8c-5d26-4830-8deb-d015a93a5ac1 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.157471 Sep 09 13:19:41.524028 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 381/754] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:41 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:41.928522 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c946d809-e9f9-4e15-b5a9-1b6de9fc1cc5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:41.929133 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c946d809-e9f9-4e15-b5a9-1b6de9fc1cc5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:41.935298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c946d809-e9f9-4e15-b5a9-1b6de9fc1cc5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:41.935833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c946d809-e9f9-4e15-b5a9-1b6de9fc1cc5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:41.936264 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c946d809-e9f9-4e15-b5a9-1b6de9fc1cc5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:41.936943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c946d809-e9f9-4e15-b5a9-1b6de9fc1cc5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:41.937391 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c946d809-e9f9-4e15-b5a9-1b6de9fc1cc5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:41.937810 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c946d809-e9f9-4e15-b5a9-1b6de9fc1cc5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:42.067747 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c946d809-e9f9-4e15-b5a9-1b6de9fc1cc5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:42.076253 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c946d809-e9f9-4e15-b5a9-1b6de9fc1cc5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.151522 Sep 09 13:19:42.076821 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 374/755] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:41 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:42.391509 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6f8da713-2136-4088-951f-cf51cdb5adb3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:42.392030 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6f8da713-2136-4088-951f-cf51cdb5adb3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:42.398395 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f8da713-2136-4088-951f-cf51cdb5adb3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:42.398876 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f8da713-2136-4088-951f-cf51cdb5adb3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:42.399346 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f8da713-2136-4088-951f-cf51cdb5adb3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:42.400033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f8da713-2136-4088-951f-cf51cdb5adb3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:42.401078 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f8da713-2136-4088-951f-cf51cdb5adb3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:42.401784 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6f8da713-2136-4088-951f-cf51cdb5adb3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:42.511518 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-38cd97f7-6773-44a7-96ab-d62ab27e3b95 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:42.512136 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-38cd97f7-6773-44a7-96ab-d62ab27e3b95 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:42.518557 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38cd97f7-6773-44a7-96ab-d62ab27e3b95 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:42.519146 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38cd97f7-6773-44a7-96ab-d62ab27e3b95 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:42.519581 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38cd97f7-6773-44a7-96ab-d62ab27e3b95 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:42.520265 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38cd97f7-6773-44a7-96ab-d62ab27e3b95 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:42.520739 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38cd97f7-6773-44a7-96ab-d62ab27e3b95 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:42.521153 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38cd97f7-6773-44a7-96ab-d62ab27e3b95 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:42.533484 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f8da713-2136-4088-951f-cf51cdb5adb3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:42.543298 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f8da713-2136-4088-951f-cf51cdb5adb3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:42.544739 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6f8da713-2136-4088-951f-cf51cdb5adb3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:42.545917 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6f8da713-2136-4088-951f-cf51cdb5adb3 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.158808 Sep 09 13:19:42.546504 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 382/756] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:42 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:42.559264 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-02f11a8f-9920-4ea6-b48f-65e997900e90 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:42.559264 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-02f11a8f-9920-4ea6-b48f-65e997900e90 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:42.559264 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02f11a8f-9920-4ea6-b48f-65e997900e90 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:42.559264 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02f11a8f-9920-4ea6-b48f-65e997900e90 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:42.559652 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02f11a8f-9920-4ea6-b48f-65e997900e90 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:42.559652 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02f11a8f-9920-4ea6-b48f-65e997900e90 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:42.559876 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02f11a8f-9920-4ea6-b48f-65e997900e90 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:42.560293 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-02f11a8f-9920-4ea6-b48f-65e997900e90 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:42.653023 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-38cd97f7-6773-44a7-96ab-d62ab27e3b95 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:42.661181 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-38cd97f7-6773-44a7-96ab-d62ab27e3b95 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1721 microversion: 2.1 time: 0.153798 Sep 09 13:19:42.661746 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 375/757] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:42 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:42.691612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-02f11a8f-9920-4ea6-b48f-65e997900e90 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:42.699681 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-02f11a8f-9920-4ea6-b48f-65e997900e90 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1318 microversion: 2.1 time: 0.152146 Sep 09 13:19:42.700241 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 383/758] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:42 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:43.099604 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4ebd27e3-672b-4133-9b30-7a1d0d43ff89 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:43.100217 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4ebd27e3-672b-4133-9b30-7a1d0d43ff89 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:43.106119 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ebd27e3-672b-4133-9b30-7a1d0d43ff89 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:43.106594 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ebd27e3-672b-4133-9b30-7a1d0d43ff89 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:43.107024 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ebd27e3-672b-4133-9b30-7a1d0d43ff89 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:43.107735 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ebd27e3-672b-4133-9b30-7a1d0d43ff89 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:43.108186 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ebd27e3-672b-4133-9b30-7a1d0d43ff89 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:43.108607 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4ebd27e3-672b-4133-9b30-7a1d0d43ff89 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:43.239967 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4ebd27e3-672b-4133-9b30-7a1d0d43ff89 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:43.248095 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4ebd27e3-672b-4133-9b30-7a1d0d43ff89 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.152374 Sep 09 13:19:43.248657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 376/759] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:43 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:43.572211 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-aac4e3ab-30c8-4e41-a09f-5cd4d605cc4b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:43.573065 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-aac4e3ab-30c8-4e41-a09f-5cd4d605cc4b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:43.579610 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aac4e3ab-30c8-4e41-a09f-5cd4d605cc4b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:43.580088 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aac4e3ab-30c8-4e41-a09f-5cd4d605cc4b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:43.580512 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aac4e3ab-30c8-4e41-a09f-5cd4d605cc4b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:43.581192 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aac4e3ab-30c8-4e41-a09f-5cd4d605cc4b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:43.581635 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aac4e3ab-30c8-4e41-a09f-5cd4d605cc4b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:43.582048 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-aac4e3ab-30c8-4e41-a09f-5cd4d605cc4b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:43.686169 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-860d2224-b119-4a50-9ae0-440cf15b87bf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:43.686845 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-860d2224-b119-4a50-9ae0-440cf15b87bf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:43.689102 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:43.694227 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-860d2224-b119-4a50-9ae0-440cf15b87bf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:43.694719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-860d2224-b119-4a50-9ae0-440cf15b87bf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:43.695400 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-860d2224-b119-4a50-9ae0-440cf15b87bf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:43.696112 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-860d2224-b119-4a50-9ae0-440cf15b87bf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:43.697055 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-860d2224-b119-4a50-9ae0-440cf15b87bf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:43.697055 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-860d2224-b119-4a50-9ae0-440cf15b87bf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:43.714347 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-aac4e3ab-30c8-4e41-a09f-5cd4d605cc4b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:43.723258 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-aac4e3ab-30c8-4e41-a09f-5cd4d605cc4b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:43.724710 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-aac4e3ab-30c8-4e41-a09f-5cd4d605cc4b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:43.725873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-aac4e3ab-30c8-4e41-a09f-5cd4d605cc4b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.157736 Sep 09 13:19:43.726434 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 384/760] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:43 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:43.731635 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2c6bcdf4-e3da-4bcb-ace8-0e86253c50d2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:43.732244 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2c6bcdf4-e3da-4bcb-ace8-0e86253c50d2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:43.738110 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c6bcdf4-e3da-4bcb-ace8-0e86253c50d2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:43.738597 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c6bcdf4-e3da-4bcb-ace8-0e86253c50d2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:43.739034 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c6bcdf4-e3da-4bcb-ace8-0e86253c50d2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:43.739759 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c6bcdf4-e3da-4bcb-ace8-0e86253c50d2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:43.740391 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c6bcdf4-e3da-4bcb-ace8-0e86253c50d2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:43.740820 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2c6bcdf4-e3da-4bcb-ace8-0e86253c50d2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:43.830780 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-860d2224-b119-4a50-9ae0-440cf15b87bf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:43.840497 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-860d2224-b119-4a50-9ae0-440cf15b87bf tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1727 microversion: 2.1 time: 0.158907 Sep 09 13:19:43.841083 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 377/761] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:43 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:43.863726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5b2ca4a4-dcd1-4317-a591-54b28732ebfd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:43.864223 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5b2ca4a4-dcd1-4317-a591-54b28732ebfd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:43.870778 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b2ca4a4-dcd1-4317-a591-54b28732ebfd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:43.872335 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b2ca4a4-dcd1-4317-a591-54b28732ebfd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:43.872335 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b2ca4a4-dcd1-4317-a591-54b28732ebfd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:43.872570 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b2ca4a4-dcd1-4317-a591-54b28732ebfd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:43.872890 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b2ca4a4-dcd1-4317-a591-54b28732ebfd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:43.873316 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b2ca4a4-dcd1-4317-a591-54b28732ebfd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:43.876450 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-2c6bcdf4-e3da-4bcb-ace8-0e86253c50d2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:43.891142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2c6bcdf4-e3da-4bcb-ace8-0e86253c50d2 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1506 microversion: 2.1 time: 0.163054 Sep 09 13:19:43.891142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 385/762] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:43 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:43.914066 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c00cb3f-654f-4ebd-8771-ea64f23b6a12 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc7c775d-2759-4e02-88a4-95dd7460b9ea", "device": "/dev/sdb"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:43.917396 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3c00cb3f-654f-4ebd-8771-ea64f23b6a12 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:43.924172 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c00cb3f-654f-4ebd-8771-ea64f23b6a12 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:43.924746 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c00cb3f-654f-4ebd-8771-ea64f23b6a12 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:43.925261 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c00cb3f-654f-4ebd-8771-ea64f23b6a12 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:43.926034 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c00cb3f-654f-4ebd-8771-ea64f23b6a12 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:43.926564 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c00cb3f-654f-4ebd-8771-ea64f23b6a12 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:43.927076 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c00cb3f-654f-4ebd-8771-ea64f23b6a12 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:43.960181 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5b2ca4a4-dcd1-4317-a591-54b28732ebfd tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100382 Sep 09 13:19:43.960771 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 378/763] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 13:19:43 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:19:44.271257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-570a367b-c40d-4b86-a7ad-02ca925bd81e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:44.271874 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-570a367b-c40d-4b86-a7ad-02ca925bd81e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:44.278684 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-570a367b-c40d-4b86-a7ad-02ca925bd81e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:44.279203 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-570a367b-c40d-4b86-a7ad-02ca925bd81e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:44.279645 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-570a367b-c40d-4b86-a7ad-02ca925bd81e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:44.280337 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-570a367b-c40d-4b86-a7ad-02ca925bd81e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:44.280794 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-570a367b-c40d-4b86-a7ad-02ca925bd81e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:44.281224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-570a367b-c40d-4b86-a7ad-02ca925bd81e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:44.742983 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-570a367b-c40d-4b86-a7ad-02ca925bd81e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:44.751421 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-570a367b-c40d-4b86-a7ad-02ca925bd81e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1366 microversion: 2.1 time: 0.484035 Sep 09 13:19:44.752001 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 379/764] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:44 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1366 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:44.756436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a2c0ca22-1a10-4790-b26e-d85f268ab8f0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:44.757023 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a2c0ca22-1a10-4790-b26e-d85f268ab8f0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:44.763661 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2c0ca22-1a10-4790-b26e-d85f268ab8f0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:44.764149 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2c0ca22-1a10-4790-b26e-d85f268ab8f0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:44.764589 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2c0ca22-1a10-4790-b26e-d85f268ab8f0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:44.765291 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2c0ca22-1a10-4790-b26e-d85f268ab8f0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:44.765750 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2c0ca22-1a10-4790-b26e-d85f268ab8f0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:44.766182 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a2c0ca22-1a10-4790-b26e-d85f268ab8f0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:45.006480 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a2c0ca22-1a10-4790-b26e-d85f268ab8f0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:45.015177 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a2c0ca22-1a10-4790-b26e-d85f268ab8f0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:45.016621 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a2c0ca22-1a10-4790-b26e-d85f268ab8f0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:45.017780 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a2c0ca22-1a10-4790-b26e-d85f268ab8f0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.264876 Sep 09 13:19:45.018525 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 380/765] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:44 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:45.232899 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-9602a5a6-59c2-4cb6-8b9a-622d07f547aa req-a26d595e-027c-4671-a0cf-47b27332c95c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8d3e22-93f3-4251-bbfc-8bd5c60cb875", "tag": "b82ef3ba-9f78-4e05-830b-166b5fa60d7f"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:45.246560 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-9602a5a6-59c2-4cb6-8b9a-622d07f547aa req-a26d595e-027c-4671-a0cf-47b27332c95c service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:45.247036 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-9602a5a6-59c2-4cb6-8b9a-622d07f547aa req-a26d595e-027c-4671-a0cf-47b27332c95c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:45.247499 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-9602a5a6-59c2-4cb6-8b9a-622d07f547aa req-a26d595e-027c-4671-a0cf-47b27332c95c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:45.258854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-9602a5a6-59c2-4cb6-8b9a-622d07f547aa req-a26d595e-027c-4671-a0cf-47b27332c95c service nova] Creating event network-changed:b82ef3ba-9f78-4e05-830b-166b5fa60d7f for instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 on hv-cinder-83124 Sep 09 13:19:45.264340 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-9602a5a6-59c2-4cb6-8b9a-622d07f547aa req-a26d595e-027c-4671-a0cf-47b27332c95c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036643 Sep 09 13:19:45.264914 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 381/766] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:45.776372 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1bf885bc-4695-4b39-909c-1abb7645d67e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:45.777270 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1bf885bc-4695-4b39-909c-1abb7645d67e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:45.783439 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bf885bc-4695-4b39-909c-1abb7645d67e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:45.783923 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bf885bc-4695-4b39-909c-1abb7645d67e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:45.784364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bf885bc-4695-4b39-909c-1abb7645d67e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:45.785059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bf885bc-4695-4b39-909c-1abb7645d67e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:45.785511 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bf885bc-4695-4b39-909c-1abb7645d67e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:45.785940 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bf885bc-4695-4b39-909c-1abb7645d67e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:45.917977 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1bf885bc-4695-4b39-909c-1abb7645d67e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:45.925800 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1bf885bc-4695-4b39-909c-1abb7645d67e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1556 microversion: 2.1 time: 0.154675 Sep 09 13:19:45.926384 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 382/767] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:45 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:45.948620 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-57d428d5-6311-4745-b061-e95836503c58 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:45.949236 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-57d428d5-6311-4745-b061-e95836503c58 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:45.955657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-57d428d5-6311-4745-b061-e95836503c58 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:45.956246 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-57d428d5-6311-4745-b061-e95836503c58 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:45.956718 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-57d428d5-6311-4745-b061-e95836503c58 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:45.957359 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-57d428d5-6311-4745-b061-e95836503c58 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:45.957828 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-57d428d5-6311-4745-b061-e95836503c58 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:45.958238 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-57d428d5-6311-4745-b061-e95836503c58 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:46.039315 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-57d428d5-6311-4745-b061-e95836503c58 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095033 Sep 09 13:19:46.039937 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 383/768] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 13:19:45 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:19:46.045388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-604eb10c-730f-40ba-89ce-d0bf8aca8966 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:46.045983 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-604eb10c-730f-40ba-89ce-d0bf8aca8966 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:46.052197 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-604eb10c-730f-40ba-89ce-d0bf8aca8966 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:46.052682 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-604eb10c-730f-40ba-89ce-d0bf8aca8966 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:46.053363 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-604eb10c-730f-40ba-89ce-d0bf8aca8966 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:46.054277 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-604eb10c-730f-40ba-89ce-d0bf8aca8966 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:46.054726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-604eb10c-730f-40ba-89ce-d0bf8aca8966 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:46.055579 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-604eb10c-730f-40ba-89ce-d0bf8aca8966 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:46.078001 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=100 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:46.313524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-604eb10c-730f-40ba-89ce-d0bf8aca8966 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:46.323425 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-604eb10c-730f-40ba-89ce-d0bf8aca8966 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:46.324867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-604eb10c-730f-40ba-89ce-d0bf8aca8966 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:46.326032 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-604eb10c-730f-40ba-89ce-d0bf8aca8966 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.285131 Sep 09 13:19:46.326594 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 384/769] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:46 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:46.732910 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c00cb3f-654f-4ebd-8771-ea64f23b6a12 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "POST /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.822588 Sep 09 13:19:46.734466 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 386/770] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 13:19:43 2022] POST /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb/os-volume_attachments => generated 194 bytes in 2825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:19:47.278885 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-e8e8ba6c-6a54-4fd5-9c45-cb5db2a377a4 req-ca3ba040-f324-456b-9b9d-64db235cb92e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8d3e22-93f3-4251-bbfc-8bd5c60cb875", "tag": "b82ef3ba-9f78-4e05-830b-166b5fa60d7f"}, {"name": "network-changed", "server_uuid": "68162eb9-cbe5-401b-bd53-8a1a715bb164", "tag": "0fdd18ec-bd72-455b-b76a-776cd528e722"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:47.289726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e8e8ba6c-6a54-4fd5-9c45-cb5db2a377a4 req-ca3ba040-f324-456b-9b9d-64db235cb92e service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:47.290202 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e8e8ba6c-6a54-4fd5-9c45-cb5db2a377a4 req-ca3ba040-f324-456b-9b9d-64db235cb92e service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:47.290632 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-e8e8ba6c-6a54-4fd5-9c45-cb5db2a377a4 req-ca3ba040-f324-456b-9b9d-64db235cb92e service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:47.305503 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-e8e8ba6c-6a54-4fd5-9c45-cb5db2a377a4 req-ca3ba040-f324-456b-9b9d-64db235cb92e service nova] Creating event network-changed:b82ef3ba-9f78-4e05-830b-166b5fa60d7f for instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 on hv-cinder-83124 Sep 09 13:19:47.306036 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-e8e8ba6c-6a54-4fd5-9c45-cb5db2a377a4 req-ca3ba040-f324-456b-9b9d-64db235cb92e service nova] Creating event network-changed:0fdd18ec-bd72-455b-b76a-776cd528e722 for instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 on hv-cinder-83124 Sep 09 13:19:47.313202 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-e8e8ba6c-6a54-4fd5-9c45-cb5db2a377a4 req-ca3ba040-f324-456b-9b9d-64db235cb92e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038043 Sep 09 13:19:47.314106 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 385/771] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:47.352250 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-178a8def-6293-4ece-bd08-fa5cad50ddd5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:47.352874 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-178a8def-6293-4ece-bd08-fa5cad50ddd5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:47.362803 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-178a8def-6293-4ece-bd08-fa5cad50ddd5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:47.363334 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-178a8def-6293-4ece-bd08-fa5cad50ddd5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:47.363769 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-178a8def-6293-4ece-bd08-fa5cad50ddd5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:47.365335 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-178a8def-6293-4ece-bd08-fa5cad50ddd5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:47.365982 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-178a8def-6293-4ece-bd08-fa5cad50ddd5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:47.367007 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-178a8def-6293-4ece-bd08-fa5cad50ddd5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:47.580036 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-178a8def-6293-4ece-bd08-fa5cad50ddd5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:47.591680 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-178a8def-6293-4ece-bd08-fa5cad50ddd5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:47.593438 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-178a8def-6293-4ece-bd08-fa5cad50ddd5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:47.594819 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-178a8def-6293-4ece-bd08-fa5cad50ddd5 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.247046 Sep 09 13:19:47.595899 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 387/772] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:47 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:48.624959 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-42d13df8-8537-4b00-93ab-501ea015097e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:48.625653 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-42d13df8-8537-4b00-93ab-501ea015097e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:48.631829 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42d13df8-8537-4b00-93ab-501ea015097e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:48.632336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42d13df8-8537-4b00-93ab-501ea015097e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:48.632773 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42d13df8-8537-4b00-93ab-501ea015097e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:48.633460 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42d13df8-8537-4b00-93ab-501ea015097e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:48.633917 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42d13df8-8537-4b00-93ab-501ea015097e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:48.634339 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-42d13df8-8537-4b00-93ab-501ea015097e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:48.768461 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-42d13df8-8537-4b00-93ab-501ea015097e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:48.777251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-42d13df8-8537-4b00-93ab-501ea015097e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:48.778671 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-42d13df8-8537-4b00-93ab-501ea015097e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:48.779853 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-42d13df8-8537-4b00-93ab-501ea015097e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.160729 Sep 09 13:19:48.780513 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 386/773] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:48 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:19:49.095788 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-830fb1d3-b16a-4815-8ad6-fc9057874c8d req-62b7262d-d231-4148-89c0-f05321bd65e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f961e5a-6c12-48b6-ae52-e61b993275b3", "name": "network-vif-plugged", "status": "completed", "tag": "b38055a2-318f-4ddd-8392-48b0e32eee23"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:49.108728 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-830fb1d3-b16a-4815-8ad6-fc9057874c8d req-62b7262d-d231-4148-89c0-f05321bd65e7 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:49.109220 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-830fb1d3-b16a-4815-8ad6-fc9057874c8d req-62b7262d-d231-4148-89c0-f05321bd65e7 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:49.109649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-830fb1d3-b16a-4815-8ad6-fc9057874c8d req-62b7262d-d231-4148-89c0-f05321bd65e7 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:49.121882 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-830fb1d3-b16a-4815-8ad6-fc9057874c8d req-62b7262d-d231-4148-89c0-f05321bd65e7 service nova] Creating event network-vif-plugged:b38055a2-318f-4ddd-8392-48b0e32eee23 for instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 on hv-cinder-83124 Sep 09 13:19:49.126823 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-830fb1d3-b16a-4815-8ad6-fc9057874c8d req-62b7262d-d231-4148-89c0-f05321bd65e7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034958 Sep 09 13:19:49.127761 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 388/774] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:19:49.805838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2e9e9470-e6f7-44a3-81b5-f15c4adb7527 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:49.806510 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2e9e9470-e6f7-44a3-81b5-f15c4adb7527 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:49.813716 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e9e9470-e6f7-44a3-81b5-f15c4adb7527 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:49.814160 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e9e9470-e6f7-44a3-81b5-f15c4adb7527 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:49.814595 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e9e9470-e6f7-44a3-81b5-f15c4adb7527 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:49.815312 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e9e9470-e6f7-44a3-81b5-f15c4adb7527 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:49.815765 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e9e9470-e6f7-44a3-81b5-f15c4adb7527 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:49.816187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2e9e9470-e6f7-44a3-81b5-f15c4adb7527 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:49.950982 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2e9e9470-e6f7-44a3-81b5-f15c4adb7527 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:49.959538 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2e9e9470-e6f7-44a3-81b5-f15c4adb7527 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:49.960975 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2e9e9470-e6f7-44a3-81b5-f15c4adb7527 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:49.962130 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2e9e9470-e6f7-44a3-81b5-f15c4adb7527 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.160247 Sep 09 13:19:49.963615 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 387/775] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:49 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:19:50.989178 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c701230e-769f-43df-943e-6e8ef77cda7b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:50.989873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c701230e-769f-43df-943e-6e8ef77cda7b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:50.991802 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=96 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:19:50.997757 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c701230e-769f-43df-943e-6e8ef77cda7b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:50.998243 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c701230e-769f-43df-943e-6e8ef77cda7b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:50.998676 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c701230e-769f-43df-943e-6e8ef77cda7b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:50.999395 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c701230e-769f-43df-943e-6e8ef77cda7b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:50.999848 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c701230e-769f-43df-943e-6e8ef77cda7b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:51.000268 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c701230e-769f-43df-943e-6e8ef77cda7b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:51.138157 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c701230e-769f-43df-943e-6e8ef77cda7b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:51.146671 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c701230e-769f-43df-943e-6e8ef77cda7b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:51.148147 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c701230e-769f-43df-943e-6e8ef77cda7b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:51.149296 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c701230e-769f-43df-943e-6e8ef77cda7b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.164924 Sep 09 13:19:51.149849 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 389/776] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:50 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:52.175077 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d0510a7d-63a8-4cf1-b90a-cdad06f6ca86 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:52.175684 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d0510a7d-63a8-4cf1-b90a-cdad06f6ca86 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:52.182227 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0510a7d-63a8-4cf1-b90a-cdad06f6ca86 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:52.182706 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0510a7d-63a8-4cf1-b90a-cdad06f6ca86 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:52.183182 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0510a7d-63a8-4cf1-b90a-cdad06f6ca86 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:52.183875 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0510a7d-63a8-4cf1-b90a-cdad06f6ca86 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:52.184332 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0510a7d-63a8-4cf1-b90a-cdad06f6ca86 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:52.184781 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0510a7d-63a8-4cf1-b90a-cdad06f6ca86 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:52.311712 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d0510a7d-63a8-4cf1-b90a-cdad06f6ca86 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:52.320104 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d0510a7d-63a8-4cf1-b90a-cdad06f6ca86 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:52.321532 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d0510a7d-63a8-4cf1-b90a-cdad06f6ca86 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:52.322685 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d0510a7d-63a8-4cf1-b90a-cdad06f6ca86 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.151503 Sep 09 13:19:52.323468 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 388/777] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:52 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:53.348713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-89c081ad-c2cd-490c-9b45-b23f67acbc97 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:53.349321 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-89c081ad-c2cd-490c-9b45-b23f67acbc97 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:53.356477 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89c081ad-c2cd-490c-9b45-b23f67acbc97 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:53.357436 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89c081ad-c2cd-490c-9b45-b23f67acbc97 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:53.357665 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89c081ad-c2cd-490c-9b45-b23f67acbc97 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:53.358370 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89c081ad-c2cd-490c-9b45-b23f67acbc97 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:53.358824 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89c081ad-c2cd-490c-9b45-b23f67acbc97 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:53.359289 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-89c081ad-c2cd-490c-9b45-b23f67acbc97 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:53.495514 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-89c081ad-c2cd-490c-9b45-b23f67acbc97 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:53.505070 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-89c081ad-c2cd-490c-9b45-b23f67acbc97 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:53.506465 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-89c081ad-c2cd-490c-9b45-b23f67acbc97 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:53.507664 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-89c081ad-c2cd-490c-9b45-b23f67acbc97 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1808 microversion: 2.20 time: 0.162835 Sep 09 13:19:53.508218 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 390/778] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:53 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:54.533004 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e886e9fb-b975-4469-9a5d-18fcba909edf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:54.533669 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e886e9fb-b975-4469-9a5d-18fcba909edf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:54.540552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e886e9fb-b975-4469-9a5d-18fcba909edf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:54.541706 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e886e9fb-b975-4469-9a5d-18fcba909edf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:54.542249 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e886e9fb-b975-4469-9a5d-18fcba909edf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:54.542939 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e886e9fb-b975-4469-9a5d-18fcba909edf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:54.543419 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e886e9fb-b975-4469-9a5d-18fcba909edf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:54.543847 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e886e9fb-b975-4469-9a5d-18fcba909edf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:54.686939 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e886e9fb-b975-4469-9a5d-18fcba909edf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:54.695832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e886e9fb-b975-4469-9a5d-18fcba909edf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:54.698024 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e886e9fb-b975-4469-9a5d-18fcba909edf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:54.699212 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e886e9fb-b975-4469-9a5d-18fcba909edf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1795 microversion: 2.20 time: 0.170130 Sep 09 13:19:54.699778 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 389/779] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:19:54 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1795 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:19:54.795680 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dc02f26e-3247-4de5-bd5b-59f7f430e2de tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:19:54.797826 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dc02f26e-3247-4de5-bd5b-59f7f430e2de tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:54.804495 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc02f26e-3247-4de5-bd5b-59f7f430e2de tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:54.804984 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc02f26e-3247-4de5-bd5b-59f7f430e2de tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:54.805426 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc02f26e-3247-4de5-bd5b-59f7f430e2de tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:54.806110 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc02f26e-3247-4de5-bd5b-59f7f430e2de tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:54.806630 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc02f26e-3247-4de5-bd5b-59f7f430e2de tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:54.807294 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dc02f26e-3247-4de5-bd5b-59f7f430e2de tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:54.879139 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dc02f26e-3247-4de5-bd5b-59f7f430e2de tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "POST /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/action" status: 202 len: 0 microversion: 2.1 time: 0.088016 Sep 09 13:19:54.882697 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 391/780] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 13:19:54 2022] POST /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:19:54.888261 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-55274e3b-9809-4154-ad0d-e271c4bf8e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:54.888871 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-55274e3b-9809-4154-ad0d-e271c4bf8e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:54.894850 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55274e3b-9809-4154-ad0d-e271c4bf8e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:54.895362 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55274e3b-9809-4154-ad0d-e271c4bf8e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:54.895795 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55274e3b-9809-4154-ad0d-e271c4bf8e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:54.896483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55274e3b-9809-4154-ad0d-e271c4bf8e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:54.896948 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55274e3b-9809-4154-ad0d-e271c4bf8e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:54.897364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-55274e3b-9809-4154-ad0d-e271c4bf8e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:55.038188 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-55274e3b-9809-4154-ad0d-e271c4bf8e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:55.046673 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-55274e3b-9809-4154-ad0d-e271c4bf8e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1753 microversion: 2.1 time: 0.162636 Sep 09 13:19:55.047205 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 390/781] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:54 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:56.071358 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-21635c3a-bfdc-4577-bae3-786673dcb2fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:56.072051 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-21635c3a-bfdc-4577-bae3-786673dcb2fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:56.079873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21635c3a-bfdc-4577-bae3-786673dcb2fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:56.080352 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21635c3a-bfdc-4577-bae3-786673dcb2fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:56.080781 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21635c3a-bfdc-4577-bae3-786673dcb2fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:56.081470 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21635c3a-bfdc-4577-bae3-786673dcb2fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:56.081915 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21635c3a-bfdc-4577-bae3-786673dcb2fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:56.082331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-21635c3a-bfdc-4577-bae3-786673dcb2fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:56.230349 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-21635c3a-bfdc-4577-bae3-786673dcb2fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:56.238519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-21635c3a-bfdc-4577-bae3-786673dcb2fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.171406 Sep 09 13:19:56.239089 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 392/782] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:56 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:57.261921 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a116881c-7444-4ab2-afa4-419c6a175fb9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:57.262537 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a116881c-7444-4ab2-afa4-419c6a175fb9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:57.269672 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a116881c-7444-4ab2-afa4-419c6a175fb9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:57.270156 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a116881c-7444-4ab2-afa4-419c6a175fb9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:57.270593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a116881c-7444-4ab2-afa4-419c6a175fb9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:57.271313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a116881c-7444-4ab2-afa4-419c6a175fb9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:57.271774 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a116881c-7444-4ab2-afa4-419c6a175fb9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:57.272198 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a116881c-7444-4ab2-afa4-419c6a175fb9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:57.421634 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a116881c-7444-4ab2-afa4-419c6a175fb9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:57.429804 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a116881c-7444-4ab2-afa4-419c6a175fb9 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.171889 Sep 09 13:19:57.430366 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 391/783] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:57 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:58.299604 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4a202f75-9626-4d53-9589-58f46ce64f4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:58.301835 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4a202f75-9626-4d53-9589-58f46ce64f4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:58.308959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a202f75-9626-4d53-9589-58f46ce64f4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:58.309434 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a202f75-9626-4d53-9589-58f46ce64f4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:58.309866 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a202f75-9626-4d53-9589-58f46ce64f4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:58.310546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a202f75-9626-4d53-9589-58f46ce64f4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:58.311015 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a202f75-9626-4d53-9589-58f46ce64f4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:58.311453 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a202f75-9626-4d53-9589-58f46ce64f4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:58.339826 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4a202f75-9626-4d53-9589-58f46ce64f4a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044076 Sep 09 13:19:58.340367 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 393/784] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:19:58 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:19:58.403149 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-03c69a86-8324-4f33-9da9-81d806409eba tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:58.403661 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-03c69a86-8324-4f33-9da9-81d806409eba tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:58.409924 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03c69a86-8324-4f33-9da9-81d806409eba tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:58.410400 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03c69a86-8324-4f33-9da9-81d806409eba tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:58.410827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03c69a86-8324-4f33-9da9-81d806409eba tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:58.411533 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03c69a86-8324-4f33-9da9-81d806409eba tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:58.411986 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03c69a86-8324-4f33-9da9-81d806409eba tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:58.412410 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-03c69a86-8324-4f33-9da9-81d806409eba tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:58.438095 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-03c69a86-8324-4f33-9da9-81d806409eba tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:19:58.452888 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4395462a-df8b-44e8-a8fc-9f9660da7fae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:58.453499 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4395462a-df8b-44e8-a8fc-9f9660da7fae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:58.459287 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4395462a-df8b-44e8-a8fc-9f9660da7fae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:58.459770 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4395462a-df8b-44e8-a8fc-9f9660da7fae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:58.460200 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4395462a-df8b-44e8-a8fc-9f9660da7fae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:58.460891 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4395462a-df8b-44e8-a8fc-9f9660da7fae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:58.461338 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4395462a-df8b-44e8-a8fc-9f9660da7fae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:58.461758 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4395462a-df8b-44e8-a8fc-9f9660da7fae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:58.525748 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-03c69a86-8324-4f33-9da9-81d806409eba tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 204 len: 0 microversion: 2.1 time: 0.125186 Sep 09 13:19:58.526538 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 392/785] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:19:58 2022] DELETE /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:19:58.534941 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-20e6869c-f050-4314-9b0f-420ebb94a879 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:58.535668 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-20e6869c-f050-4314-9b0f-420ebb94a879 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:58.542027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-20e6869c-f050-4314-9b0f-420ebb94a879 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:58.542511 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-20e6869c-f050-4314-9b0f-420ebb94a879 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:58.542943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-20e6869c-f050-4314-9b0f-420ebb94a879 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:58.543665 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-20e6869c-f050-4314-9b0f-420ebb94a879 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:58.544121 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-20e6869c-f050-4314-9b0f-420ebb94a879 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:58.544550 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-20e6869c-f050-4314-9b0f-420ebb94a879 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:58.624971 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4395462a-df8b-44e8-a8fc-9f9660da7fae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:58.633404 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4395462a-df8b-44e8-a8fc-9f9660da7fae tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.184416 Sep 09 13:19:58.633965 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 394/786] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:58 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:58.682254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-20e6869c-f050-4314-9b0f-420ebb94a879 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:58.690036 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-20e6869c-f050-4314-9b0f-420ebb94a879 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1673 microversion: 2.1 time: 0.159252 Sep 09 13:19:58.690606 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 393/787] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:58 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:19:59.656431 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7e29f8ba-491c-4329-8209-b00c5a8356fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:59.657384 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7e29f8ba-491c-4329-8209-b00c5a8356fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:59.663771 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e29f8ba-491c-4329-8209-b00c5a8356fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:59.664251 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e29f8ba-491c-4329-8209-b00c5a8356fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:59.664679 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e29f8ba-491c-4329-8209-b00c5a8356fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:59.665367 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e29f8ba-491c-4329-8209-b00c5a8356fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:59.665794 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e29f8ba-491c-4329-8209-b00c5a8356fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:59.666780 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7e29f8ba-491c-4329-8209-b00c5a8356fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:59.716629 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-aed51263-a157-4bb0-bdf4-ea473137553f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:19:59.717980 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-aed51263-a157-4bb0-bdf4-ea473137553f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:19:59.725821 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aed51263-a157-4bb0-bdf4-ea473137553f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:59.726605 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aed51263-a157-4bb0-bdf4-ea473137553f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:59.727159 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aed51263-a157-4bb0-bdf4-ea473137553f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:59.727891 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aed51263-a157-4bb0-bdf4-ea473137553f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:19:59.729221 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aed51263-a157-4bb0-bdf4-ea473137553f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:19:59.729940 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aed51263-a157-4bb0-bdf4-ea473137553f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:19:59.828115 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7e29f8ba-491c-4329-8209-b00c5a8356fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:59.838397 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7e29f8ba-491c-4329-8209-b00c5a8356fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.185050 Sep 09 13:19:59.839347 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 395/788] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:59 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:19:59.907080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-aed51263-a157-4bb0-bdf4-ea473137553f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:19:59.914862 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-aed51263-a157-4bb0-bdf4-ea473137553f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1673 microversion: 2.1 time: 0.205000 Sep 09 13:19:59.915457 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 394/789] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:19:59 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:20:00.862855 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-10ba1663-0df0-490e-a69f-e268f1015cd7 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:00.863427 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-10ba1663-0df0-490e-a69f-e268f1015cd7 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:00.870951 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10ba1663-0df0-490e-a69f-e268f1015cd7 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:00.871458 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10ba1663-0df0-490e-a69f-e268f1015cd7 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:00.871897 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10ba1663-0df0-490e-a69f-e268f1015cd7 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:00.872598 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10ba1663-0df0-490e-a69f-e268f1015cd7 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:00.873054 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10ba1663-0df0-490e-a69f-e268f1015cd7 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:00.873479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-10ba1663-0df0-490e-a69f-e268f1015cd7 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:00.938861 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d93aff6d-7f5b-4c2c-9982-a0cc7f53b11b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:00.939517 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d93aff6d-7f5b-4c2c-9982-a0cc7f53b11b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:00.945922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d93aff6d-7f5b-4c2c-9982-a0cc7f53b11b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:00.946408 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d93aff6d-7f5b-4c2c-9982-a0cc7f53b11b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:00.946848 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d93aff6d-7f5b-4c2c-9982-a0cc7f53b11b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:00.947608 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d93aff6d-7f5b-4c2c-9982-a0cc7f53b11b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:00.948069 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d93aff6d-7f5b-4c2c-9982-a0cc7f53b11b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:00.948499 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d93aff6d-7f5b-4c2c-9982-a0cc7f53b11b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:01.028811 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-10ba1663-0df0-490e-a69f-e268f1015cd7 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:01.032330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:01.038237 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-10ba1663-0df0-490e-a69f-e268f1015cd7 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.179303 Sep 09 13:20:01.038811 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 396/790] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:00 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:01.077892 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d93aff6d-7f5b-4c2c-9982-a0cc7f53b11b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:01.085679 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d93aff6d-7f5b-4c2c-9982-a0cc7f53b11b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1673 microversion: 2.1 time: 0.150709 Sep 09 13:20:01.086251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 395/791] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:00 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:20:02.062782 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1201c36c-aacc-4339-b69d-ba41ebab49fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:02.063415 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1201c36c-aacc-4339-b69d-ba41ebab49fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:02.070310 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1201c36c-aacc-4339-b69d-ba41ebab49fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:02.070838 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1201c36c-aacc-4339-b69d-ba41ebab49fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:02.071296 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1201c36c-aacc-4339-b69d-ba41ebab49fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:02.071988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1201c36c-aacc-4339-b69d-ba41ebab49fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:02.073126 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1201c36c-aacc-4339-b69d-ba41ebab49fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:02.073551 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1201c36c-aacc-4339-b69d-ba41ebab49fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:02.109231 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-05d651fe-a561-4006-beea-2251cb4408b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:02.109854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-05d651fe-a561-4006-beea-2251cb4408b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:02.116241 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05d651fe-a561-4006-beea-2251cb4408b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:02.116722 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05d651fe-a561-4006-beea-2251cb4408b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:02.117153 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05d651fe-a561-4006-beea-2251cb4408b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:02.117843 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05d651fe-a561-4006-beea-2251cb4408b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:02.118293 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05d651fe-a561-4006-beea-2251cb4408b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:02.118715 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-05d651fe-a561-4006-beea-2251cb4408b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:02.217731 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1201c36c-aacc-4339-b69d-ba41ebab49fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:02.226368 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1201c36c-aacc-4339-b69d-ba41ebab49fb tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.168058 Sep 09 13:20:02.226935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 397/792] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:02 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:02.252013 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-05d651fe-a561-4006-beea-2251cb4408b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:02.259770 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-05d651fe-a561-4006-beea-2251cb4408b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1673 microversion: 2.1 time: 0.154248 Sep 09 13:20:02.260694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 396/793] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:02 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:20:03.250168 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7d16a358-30f5-43cb-bf8b-b375f693bef8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:03.250775 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7d16a358-30f5-43cb-bf8b-b375f693bef8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:03.257242 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d16a358-30f5-43cb-bf8b-b375f693bef8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:03.257712 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d16a358-30f5-43cb-bf8b-b375f693bef8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:03.258139 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d16a358-30f5-43cb-bf8b-b375f693bef8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:03.258810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d16a358-30f5-43cb-bf8b-b375f693bef8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:03.259288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d16a358-30f5-43cb-bf8b-b375f693bef8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:03.260262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7d16a358-30f5-43cb-bf8b-b375f693bef8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:03.283447 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c86b9909-56d5-45dd-b22e-3134da595fb8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:03.284067 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c86b9909-56d5-45dd-b22e-3134da595fb8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:03.290374 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c86b9909-56d5-45dd-b22e-3134da595fb8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:03.290892 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c86b9909-56d5-45dd-b22e-3134da595fb8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:03.291450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c86b9909-56d5-45dd-b22e-3134da595fb8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:03.292151 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c86b9909-56d5-45dd-b22e-3134da595fb8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:03.292605 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c86b9909-56d5-45dd-b22e-3134da595fb8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:03.293028 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c86b9909-56d5-45dd-b22e-3134da595fb8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:03.408456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7d16a358-30f5-43cb-bf8b-b375f693bef8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:03.417241 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7d16a358-30f5-43cb-bf8b-b375f693bef8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.170855 Sep 09 13:20:03.417821 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 398/794] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:03 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:03.427009 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c86b9909-56d5-45dd-b22e-3134da595fb8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:03.435371 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c86b9909-56d5-45dd-b22e-3134da595fb8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1673 microversion: 2.1 time: 0.155760 Sep 09 13:20:03.435926 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 397/795] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:03 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:20:04.441262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-33b2407c-6de8-4e1b-8f91-372d66e20563 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:04.441868 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-33b2407c-6de8-4e1b-8f91-372d66e20563 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:04.448947 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33b2407c-6de8-4e1b-8f91-372d66e20563 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:04.449426 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33b2407c-6de8-4e1b-8f91-372d66e20563 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:04.449851 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33b2407c-6de8-4e1b-8f91-372d66e20563 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:04.450536 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33b2407c-6de8-4e1b-8f91-372d66e20563 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:04.450980 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33b2407c-6de8-4e1b-8f91-372d66e20563 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:04.451423 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33b2407c-6de8-4e1b-8f91-372d66e20563 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:04.458764 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-aa02c37b-ca8c-4acf-9713-ebfcb7968498 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:04.459397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-aa02c37b-ca8c-4acf-9713-ebfcb7968498 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:04.466615 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa02c37b-ca8c-4acf-9713-ebfcb7968498 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:04.467271 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa02c37b-ca8c-4acf-9713-ebfcb7968498 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:04.467714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa02c37b-ca8c-4acf-9713-ebfcb7968498 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:04.468411 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa02c37b-ca8c-4acf-9713-ebfcb7968498 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:04.468867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa02c37b-ca8c-4acf-9713-ebfcb7968498 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:04.469291 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aa02c37b-ca8c-4acf-9713-ebfcb7968498 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:04.535334 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-aa02c37b-ca8c-4acf-9713-ebfcb7968498 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:04.544380 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-aa02c37b-ca8c-4acf-9713-ebfcb7968498 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1605 microversion: 2.1 time: 0.089505 Sep 09 13:20:04.559687 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 398/796] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:04 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1605 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:04.624697 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-19b9d145-542b-4f5d-8728-e7d1c0ebf60b req-dd03b891-3cf8-4d9c-b847-c93c994850dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f12266-677e-473d-8fbd-bf3136398e58", "name": "network-vif-deleted", "tag": "d0f7b8a7-7f54-44ba-988c-5391e6311e17"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:20:04.647674 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-19b9d145-542b-4f5d-8728-e7d1c0ebf60b req-dd03b891-3cf8-4d9c-b847-c93c994850dc service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:04.648976 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-19b9d145-542b-4f5d-8728-e7d1c0ebf60b req-dd03b891-3cf8-4d9c-b847-c93c994850dc service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:04.649577 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-19b9d145-542b-4f5d-8728-e7d1c0ebf60b req-dd03b891-3cf8-4d9c-b847-c93c994850dc service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:04.663391 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-33b2407c-6de8-4e1b-8f91-372d66e20563 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:04.672312 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-19b9d145-542b-4f5d-8728-e7d1c0ebf60b req-dd03b891-3cf8-4d9c-b847-c93c994850dc service nova] Creating event network-vif-deleted:d0f7b8a7-7f54-44ba-988c-5391e6311e17 for instance d7f12266-677e-473d-8fbd-bf3136398e58 on hv-cinder-83124 Sep 09 13:20:04.675263 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-33b2407c-6de8-4e1b-8f91-372d66e20563 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.237702 Sep 09 13:20:04.675857 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 399/797] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:04 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:04.685433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-19b9d145-542b-4f5d-8728-e7d1c0ebf60b req-dd03b891-3cf8-4d9c-b847-c93c994850dc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065434 Sep 09 13:20:04.686041 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 399/798] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:20:05.568787 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dce421b9-207b-4cf8-8b4f-e1afdf0e04ac tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:05.569414 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dce421b9-207b-4cf8-8b4f-e1afdf0e04ac tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:05.580467 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce421b9-207b-4cf8-8b4f-e1afdf0e04ac tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:05.581256 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce421b9-207b-4cf8-8b4f-e1afdf0e04ac tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:05.582252 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce421b9-207b-4cf8-8b4f-e1afdf0e04ac tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:05.583173 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce421b9-207b-4cf8-8b4f-e1afdf0e04ac tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:05.583894 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce421b9-207b-4cf8-8b4f-e1afdf0e04ac tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:05.584495 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce421b9-207b-4cf8-8b4f-e1afdf0e04ac tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:05.634240 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce421b9-207b-4cf8-8b4f-e1afdf0e04ac tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:05.634931 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce421b9-207b-4cf8-8b4f-e1afdf0e04ac tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:05.635503 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dce421b9-207b-4cf8-8b4f-e1afdf0e04ac tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:05.636031 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-dce421b9-207b-4cf8-8b4f-e1afdf0e04ac tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lazy-loading 'fault' on Instance uuid d7f12266-677e-473d-8fbd-bf3136398e58 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:20:05.692095 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-dce421b9-207b-4cf8-8b4f-e1afdf0e04ac tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:05.700656 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dce421b9-207b-4cf8-8b4f-e1afdf0e04ac tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 200 len: 1327 microversion: 2.1 time: 0.135714 Sep 09 13:20:05.701236 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 400/799] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:05 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 1327 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:05.703913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2feb138e-612b-4c82-ad95-2d29aed91c26 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:05.704627 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2feb138e-612b-4c82-ad95-2d29aed91c26 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:05.710920 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2feb138e-612b-4c82-ad95-2d29aed91c26 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:05.711442 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2feb138e-612b-4c82-ad95-2d29aed91c26 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:05.711877 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2feb138e-612b-4c82-ad95-2d29aed91c26 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:05.713300 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2feb138e-612b-4c82-ad95-2d29aed91c26 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:05.723621 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2feb138e-612b-4c82-ad95-2d29aed91c26 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:05.724251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2feb138e-612b-4c82-ad95-2d29aed91c26 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:05.875598 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2feb138e-612b-4c82-ad95-2d29aed91c26 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:05.879072 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:05.885589 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2feb138e-612b-4c82-ad95-2d29aed91c26 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.187309 Sep 09 13:20:05.886159 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 400/800] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:05 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:20:06.724402 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e4356502-793c-4fcd-acd7-54c52f8c876b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:06.725095 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e4356502-793c-4fcd-acd7-54c52f8c876b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:06.732445 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4356502-793c-4fcd-acd7-54c52f8c876b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:06.732921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4356502-793c-4fcd-acd7-54c52f8c876b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:06.733347 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4356502-793c-4fcd-acd7-54c52f8c876b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:06.734023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4356502-793c-4fcd-acd7-54c52f8c876b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:06.734472 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4356502-793c-4fcd-acd7-54c52f8c876b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:06.734890 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e4356502-793c-4fcd-acd7-54c52f8c876b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:06.748895 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-e4356502-793c-4fcd-acd7-54c52f8c876b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] HTTP exception thrown: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e4356502-793c-4fcd-acd7-54c52f8c876b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Request method failure captured: Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 HTTP/1.1 Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzxFyARTE8GuJ8A2wFCTz71jXhnkW3Rheqj5U3l6X1lIn34mVqSeTg-pVBvkkJMCv7yhJkmGaWSjJdorZ-tGGfXouSeKXPp5tzyKXPAVQMZ6ByFMhN1h1Cjbk7MKLr7F4UfKpFXWuowo2oED0IoFlbeSlTmswsFcPndoQkRIQUpAvGg Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 6f6fd89d622647f49bd35dcaf8ceca55 Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:20:06.750523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:20:06.752142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6f6fd89d622647f49bd35dcaf8ceca55", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:20:06.752142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:20:06.752142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 6f6fd89d622647f49bd35dcaf8ceca55 Sep 09 13:20:06.752142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:20:06.752142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeTestJSON-1188854027-project Sep 09 13:20:06.752142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:20:06.752142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:20:06.752142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: c31bb28e38864eff99fdd6938b1b89a0 Sep 09 13:20:06.752142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeTestJSON-1188854027-project Sep 09 13:20:06.752142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:20:06.752142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:20:06.752142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': 'd7f12266-677e-473d-8fbd-bf3136398e58'} Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:20:06.753057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:20:06.754557 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:06.755962 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e4356502-793c-4fcd-acd7-54c52f8c876b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Returning 404 to user: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:20:06.755962 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e4356502-793c-4fcd-acd7-54c52f8c876b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 404 len: 111 microversion: 2.1 time: 0.031409 Sep 09 13:20:06.755962 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 401/801] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:06 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:20:06.761089 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3e18c19c-4b11-4992-a895-c682c36541c1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '.version_select at 0x7fd4a4f2f670>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:06.779798 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3e18c19c-4b11-4992-a895-c682c36541c1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1757740664" status: 202 len: 0 microversion: 2.1 time: 0.022929 Sep 09 13:20:06.780348 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 401/802] 10.222.0.17 () {58 vars in 1221 bytes} [Fri Sep 9 13:20:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1757740664 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:20:06.908606 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f3a8fe11-1678-4881-9134-32d1d299336c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:06.909209 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f3a8fe11-1678-4881-9134-32d1d299336c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:06.915403 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3a8fe11-1678-4881-9134-32d1d299336c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:06.916361 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3a8fe11-1678-4881-9134-32d1d299336c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:06.917078 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3a8fe11-1678-4881-9134-32d1d299336c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:06.917815 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3a8fe11-1678-4881-9134-32d1d299336c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:06.918341 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3a8fe11-1678-4881-9134-32d1d299336c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:06.918670 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3a8fe11-1678-4881-9134-32d1d299336c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:07.083927 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f3a8fe11-1678-4881-9134-32d1d299336c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:07.092824 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f3a8fe11-1678-4881-9134-32d1d299336c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.187952 Sep 09 13:20:07.093375 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 402/803] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:06 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:07.268595 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8d500a40-55aa-48c2-b358-913219fb836d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:07.269166 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8d500a40-55aa-48c2-b358-913219fb836d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:07.275695 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d500a40-55aa-48c2-b358-913219fb836d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:07.276181 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d500a40-55aa-48c2-b358-913219fb836d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:07.276611 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d500a40-55aa-48c2-b358-913219fb836d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:07.277281 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d500a40-55aa-48c2-b358-913219fb836d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:07.277723 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d500a40-55aa-48c2-b358-913219fb836d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:07.278152 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d500a40-55aa-48c2-b358-913219fb836d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:07.362451 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-8d500a40-55aa-48c2-b358-913219fb836d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lazy-loading 'services' on Instance uuid ff665b2c-17b1-41cb-b909-b7dd0e9646bb {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:20:07.434102 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c3173059-1f2c-4963-94ac-24ec5096cf4e tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Action: 'create', calling method: .version_select at 0x7fd4a51618b0>, body: {"keypair": {"name": "tempest-keypair-1808366495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDN6h90GpMd5mE0KwVBKgutpSAVyNKOPLiRzaAO+laPyKOyt9Z8lqzYWPZ689wixcYDugzAOOL0FNUhn9QMMdQaGM+rsvHXUWLxBBAbSGZmZMwTAKG6vntu3TxKrazLr8w=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:20:07.437619 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8d500a40-55aa-48c2-b358-913219fb836d tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb/os-volume_attachments/bc7c775d-2759-4e02-88a4-95dd7460b9ea" status: 202 len: 0 microversion: 2.1 time: 0.172890 Sep 09 13:20:07.438368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 402/804] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 13:20:07 2022] DELETE /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb/os-volume_attachments/bc7c775d-2759-4e02-88a4-95dd7460b9ea => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:20:07.450963 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-c3173059-1f2c-4963-94ac-24ec5096cf4e tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Getting quotas for project 6f6fd89d622647f49bd35dcaf8ceca55. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:20:07.456315 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-c3173059-1f2c-4963-94ac-24ec5096cf4e tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Getting quotas for user c31bb28e38864eff99fdd6938b1b89a0 and project 6f6fd89d622647f49bd35dcaf8ceca55. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:20:07.484142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c3173059-1f2c-4963-94ac-24ec5096cf4e tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055035 Sep 09 13:20:07.484759 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 403/805] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 13:20:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:20:08.120990 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-408c2284-7b7f-4f90-947f-708c1bcc2c71 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:08.122326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-408c2284-7b7f-4f90-947f-708c1bcc2c71 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:08.128723 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-408c2284-7b7f-4f90-947f-708c1bcc2c71 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:08.129206 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-408c2284-7b7f-4f90-947f-708c1bcc2c71 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:08.129638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-408c2284-7b7f-4f90-947f-708c1bcc2c71 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:08.130323 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-408c2284-7b7f-4f90-947f-708c1bcc2c71 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:08.130900 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-408c2284-7b7f-4f90-947f-708c1bcc2c71 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:08.131348 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-408c2284-7b7f-4f90-947f-708c1bcc2c71 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:08.329382 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-408c2284-7b7f-4f90-947f-708c1bcc2c71 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:08.338634 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-408c2284-7b7f-4f90-947f-708c1bcc2c71 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.223650 Sep 09 13:20:08.339453 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 403/806] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:08 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:08.812727 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-275752349", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "235dfee9-07ca-4a76-8598-6158055e7838"}], "security_groups": [{"name": "tempest-securitygroup--798857740"}], "key_name": "tempest-keypair-1808366495", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:20:08.917556 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] validate_networks() for [('235dfee9-07ca-4a76-8598-6158055e7838', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:20:09.327328 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:20:09.327776 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:20:09.328247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:20:09.328651 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:20:09.329056 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:20:09.337600 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:09.338171 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:09.338603 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:09.339362 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:09.339814 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:09.340231 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:09.356184 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Getting quotas for project 6f6fd89d622647f49bd35dcaf8ceca55. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:20:09.360165 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Getting quotas for user c31bb28e38864eff99fdd6938b1b89a0 and project 6f6fd89d622647f49bd35dcaf8ceca55. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:20:09.362575 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9f2dac3f-906a-43e3-bbde-7e36c8f807f6 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:09.363234 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9f2dac3f-906a-43e3-bbde-7e36c8f807f6 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:09.370246 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f2dac3f-906a-43e3-bbde-7e36c8f807f6 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:09.370825 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f2dac3f-906a-43e3-bbde-7e36c8f807f6 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:09.371296 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f2dac3f-906a-43e3-bbde-7e36c8f807f6 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:09.371892 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:20:09.372008 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f2dac3f-906a-43e3-bbde-7e36c8f807f6 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:09.372453 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f2dac3f-906a-43e3-bbde-7e36c8f807f6 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:09.372885 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f2dac3f-906a-43e3-bbde-7e36c8f807f6 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:09.374214 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:20:09.421212 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fe48e2a8-da9c-4053-b1a8-a1d8f96afbde tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.613294 Sep 09 13:20:09.428215 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 404/807] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:20:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:20:09.433718 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-693fc0da-46fa-4d34-88fe-bd02c2846d22 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:09.434498 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-693fc0da-46fa-4d34-88fe-bd02c2846d22 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:09.494720 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-693fc0da-46fa-4d34-88fe-bd02c2846d22 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:09.504983 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-693fc0da-46fa-4d34-88fe-bd02c2846d22 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1237 microversion: 2.1 time: 0.075554 Sep 09 13:20:09.505778 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 405/808] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:09 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:09.537596 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9f2dac3f-906a-43e3-bbde-7e36c8f807f6 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:09.546087 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9f2dac3f-906a-43e3-bbde-7e36c8f807f6 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.187150 Sep 09 13:20:09.546637 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 404/809] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:09 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:20:09.635614 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f6d0aafa-dcdd-4e14-83c8-541227dab1b8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:09.636233 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f6d0aafa-dcdd-4e14-83c8-541227dab1b8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:09.642188 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6d0aafa-dcdd-4e14-83c8-541227dab1b8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:09.642660 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6d0aafa-dcdd-4e14-83c8-541227dab1b8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:09.643108 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6d0aafa-dcdd-4e14-83c8-541227dab1b8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:09.643789 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6d0aafa-dcdd-4e14-83c8-541227dab1b8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:09.644242 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6d0aafa-dcdd-4e14-83c8-541227dab1b8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:09.644659 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f6d0aafa-dcdd-4e14-83c8-541227dab1b8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:09.670824 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f6d0aafa-dcdd-4e14-83c8-541227dab1b8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:20:09.753653 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f6d0aafa-dcdd-4e14-83c8-541227dab1b8 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 204 len: 0 microversion: 2.1 time: 0.122477 Sep 09 13:20:09.754554 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 406/810] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:20:09 2022] DELETE /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:20:09.762890 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-20ef14a9-5e6a-489d-ad5b-4e281d057496 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:09.763604 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-20ef14a9-5e6a-489d-ad5b-4e281d057496 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:09.770309 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-20ef14a9-5e6a-489d-ad5b-4e281d057496 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:09.770802 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-20ef14a9-5e6a-489d-ad5b-4e281d057496 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:09.771301 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-20ef14a9-5e6a-489d-ad5b-4e281d057496 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:09.772004 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-20ef14a9-5e6a-489d-ad5b-4e281d057496 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:09.772461 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-20ef14a9-5e6a-489d-ad5b-4e281d057496 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:09.772883 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-20ef14a9-5e6a-489d-ad5b-4e281d057496 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:09.913457 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-20ef14a9-5e6a-489d-ad5b-4e281d057496 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:09.922931 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-20ef14a9-5e6a-489d-ad5b-4e281d057496 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1512 microversion: 2.1 time: 0.163971 Sep 09 13:20:09.923542 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 405/811] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:09 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:20:10.530187 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-08c308d5-ba81-4032-9453-f0b896d8086a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:10.530911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-08c308d5-ba81-4032-9453-f0b896d8086a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:10.537263 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08c308d5-ba81-4032-9453-f0b896d8086a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:10.537744 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08c308d5-ba81-4032-9453-f0b896d8086a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:10.538173 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08c308d5-ba81-4032-9453-f0b896d8086a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:10.538857 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08c308d5-ba81-4032-9453-f0b896d8086a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:10.539333 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08c308d5-ba81-4032-9453-f0b896d8086a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:10.539794 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-08c308d5-ba81-4032-9453-f0b896d8086a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:10.569543 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-29ef358d-b963-4fe2-9278-7fb9011c1cf2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:10.570313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-29ef358d-b963-4fe2-9278-7fb9011c1cf2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:10.577479 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-29ef358d-b963-4fe2-9278-7fb9011c1cf2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:10.578098 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-29ef358d-b963-4fe2-9278-7fb9011c1cf2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:10.578629 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-29ef358d-b963-4fe2-9278-7fb9011c1cf2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:10.579571 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-29ef358d-b963-4fe2-9278-7fb9011c1cf2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:10.580165 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-29ef358d-b963-4fe2-9278-7fb9011c1cf2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:10.580663 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-29ef358d-b963-4fe2-9278-7fb9011c1cf2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:10.603749 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-08c308d5-ba81-4032-9453-f0b896d8086a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:10.611619 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-08c308d5-ba81-4032-9453-f0b896d8086a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1241 microversion: 2.1 time: 0.086159 Sep 09 13:20:10.617120 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 407/812] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:10 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:10.727395 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-29ef358d-b963-4fe2-9278-7fb9011c1cf2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:10.735528 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-29ef358d-b963-4fe2-9278-7fb9011c1cf2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.169776 Sep 09 13:20:10.736097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 406/813] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:10 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:20:10.946993 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b18bda9-4540-40c2-9b03-74ea759c9be3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:10.948136 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9b18bda9-4540-40c2-9b03-74ea759c9be3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:10.954041 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b18bda9-4540-40c2-9b03-74ea759c9be3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:10.954521 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b18bda9-4540-40c2-9b03-74ea759c9be3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:10.954953 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b18bda9-4540-40c2-9b03-74ea759c9be3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:10.955664 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b18bda9-4540-40c2-9b03-74ea759c9be3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:10.956117 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b18bda9-4540-40c2-9b03-74ea759c9be3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:10.956538 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b18bda9-4540-40c2-9b03-74ea759c9be3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:11.091981 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9b18bda9-4540-40c2-9b03-74ea759c9be3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:11.099574 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b18bda9-4540-40c2-9b03-74ea759c9be3 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1512 microversion: 2.1 time: 0.156461 Sep 09 13:20:11.100128 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 408/814] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:10 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:11.635170 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8ac620ed-2e0a-409f-9fed-8708c6c24f6d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:11.635786 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8ac620ed-2e0a-409f-9fed-8708c6c24f6d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:11.642339 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ac620ed-2e0a-409f-9fed-8708c6c24f6d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:11.642823 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ac620ed-2e0a-409f-9fed-8708c6c24f6d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:11.643318 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ac620ed-2e0a-409f-9fed-8708c6c24f6d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:11.644010 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ac620ed-2e0a-409f-9fed-8708c6c24f6d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:11.644493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ac620ed-2e0a-409f-9fed-8708c6c24f6d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:11.644926 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ac620ed-2e0a-409f-9fed-8708c6c24f6d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:11.759036 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9b783a6a-5540-415c-84ed-8101af06a45a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:11.759710 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9b783a6a-5540-415c-84ed-8101af06a45a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:11.766574 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b783a6a-5540-415c-84ed-8101af06a45a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:11.767089 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b783a6a-5540-415c-84ed-8101af06a45a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:11.767529 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b783a6a-5540-415c-84ed-8101af06a45a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:11.768246 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b783a6a-5540-415c-84ed-8101af06a45a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:11.768703 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b783a6a-5540-415c-84ed-8101af06a45a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:11.769128 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9b783a6a-5540-415c-84ed-8101af06a45a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:11.862021 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8ac620ed-2e0a-409f-9fed-8708c6c24f6d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:11.870652 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8ac620ed-2e0a-409f-9fed-8708c6c24f6d tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1241 microversion: 2.1 time: 0.238896 Sep 09 13:20:11.871420 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 407/815] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:11 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1241 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:11.919891 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9b783a6a-5540-415c-84ed-8101af06a45a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:11.929094 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b783a6a-5540-415c-84ed-8101af06a45a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.173764 Sep 09 13:20:11.929902 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 409/816] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:11 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:20:12.123698 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-41b916da-a384-41bc-94a9-b54d39271c33 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:12.124212 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-41b916da-a384-41bc-94a9-b54d39271c33 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:12.130286 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-41b916da-a384-41bc-94a9-b54d39271c33 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:12.130771 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-41b916da-a384-41bc-94a9-b54d39271c33 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:12.131241 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-41b916da-a384-41bc-94a9-b54d39271c33 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:12.131934 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-41b916da-a384-41bc-94a9-b54d39271c33 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:12.132385 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-41b916da-a384-41bc-94a9-b54d39271c33 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:12.132807 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-41b916da-a384-41bc-94a9-b54d39271c33 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:12.264287 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-41b916da-a384-41bc-94a9-b54d39271c33 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:12.272619 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-41b916da-a384-41bc-94a9-b54d39271c33 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1512 microversion: 2.1 time: 0.154342 Sep 09 13:20:12.273181 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 408/817] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:12 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:12.894282 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a3f014ba-7988-402e-ad43-dc1cb912275a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:12.894894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a3f014ba-7988-402e-ad43-dc1cb912275a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:12.900989 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3f014ba-7988-402e-ad43-dc1cb912275a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:12.901732 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3f014ba-7988-402e-ad43-dc1cb912275a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:12.902162 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3f014ba-7988-402e-ad43-dc1cb912275a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:12.903039 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3f014ba-7988-402e-ad43-dc1cb912275a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:12.903682 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3f014ba-7988-402e-ad43-dc1cb912275a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:12.904282 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a3f014ba-7988-402e-ad43-dc1cb912275a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:12.912351 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-96b4f375-d8aa-47ac-a0db-cbf102d3df0d req-cbf20c70-afb5-419c-bef9-53ba9143b954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff665b2c-17b1-41cb-b909-b7dd0e9646bb", "name": "network-vif-deleted", "tag": "d2757d75-8229-4684-94b8-28ebef9cfe6e"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:20:12.936290 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-96b4f375-d8aa-47ac-a0db-cbf102d3df0d req-cbf20c70-afb5-419c-bef9-53ba9143b954 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:12.936767 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-96b4f375-d8aa-47ac-a0db-cbf102d3df0d req-cbf20c70-afb5-419c-bef9-53ba9143b954 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:12.937194 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-96b4f375-d8aa-47ac-a0db-cbf102d3df0d req-cbf20c70-afb5-419c-bef9-53ba9143b954 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:12.948558 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-96b4f375-d8aa-47ac-a0db-cbf102d3df0d req-cbf20c70-afb5-419c-bef9-53ba9143b954 service nova] Creating event network-vif-deleted:d2757d75-8229-4684-94b8-28ebef9cfe6e for instance ff665b2c-17b1-41cb-b909-b7dd0e9646bb on hv-cinder-83124 Sep 09 13:20:12.953632 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-96b4f375-d8aa-47ac-a0db-cbf102d3df0d req-cbf20c70-afb5-419c-bef9-53ba9143b954 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107673 Sep 09 13:20:12.954533 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 410/818] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:20:12.961673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fbfc71df-3b0e-4f96-8631-85040ab2b063 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:12.962375 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fbfc71df-3b0e-4f96-8631-85040ab2b063 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:12.968995 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbfc71df-3b0e-4f96-8631-85040ab2b063 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:12.969474 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbfc71df-3b0e-4f96-8631-85040ab2b063 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:12.969985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbfc71df-3b0e-4f96-8631-85040ab2b063 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:12.970598 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbfc71df-3b0e-4f96-8631-85040ab2b063 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:12.971044 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbfc71df-3b0e-4f96-8631-85040ab2b063 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:12.971475 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fbfc71df-3b0e-4f96-8631-85040ab2b063 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:12.996493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a3f014ba-7988-402e-ad43-dc1cb912275a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:13.004927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a3f014ba-7988-402e-ad43-dc1cb912275a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1289 microversion: 2.1 time: 0.114966 Sep 09 13:20:13.006313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 409/819] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:12 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1289 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:20:13.217230 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fbfc71df-3b0e-4f96-8631-85040ab2b063 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:13.226425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fbfc71df-3b0e-4f96-8631-85040ab2b063 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.269133 Sep 09 13:20:13.236121 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 411/820] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:12 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:13.296925 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c3e8755b-1648-47f6-8e53-65b264744acd tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:13.297533 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c3e8755b-1648-47f6-8e53-65b264744acd tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:13.303471 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3e8755b-1648-47f6-8e53-65b264744acd tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:13.303944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3e8755b-1648-47f6-8e53-65b264744acd tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:13.304375 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3e8755b-1648-47f6-8e53-65b264744acd tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:13.305048 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3e8755b-1648-47f6-8e53-65b264744acd tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:13.305494 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3e8755b-1648-47f6-8e53-65b264744acd tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:13.305908 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3e8755b-1648-47f6-8e53-65b264744acd tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:13.337257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3e8755b-1648-47f6-8e53-65b264744acd tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:13.337655 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3e8755b-1648-47f6-8e53-65b264744acd tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:13.338091 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c3e8755b-1648-47f6-8e53-65b264744acd tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:13.338536 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-c3e8755b-1648-47f6-8e53-65b264744acd tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lazy-loading 'fault' on Instance uuid ff665b2c-17b1-41cb-b909-b7dd0e9646bb {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:20:13.378518 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c3e8755b-1648-47f6-8e53-65b264744acd tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41ec6426ddf640389083cc61e948d31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345a9eb6369c43a681649f1bb55ce60c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:13.386987 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c3e8755b-1648-47f6-8e53-65b264744acd tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 200 len: 1308 microversion: 2.1 time: 0.093881 Sep 09 13:20:13.387580 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 410/821] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:13 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:14.032194 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-491e4fcd-7006-4a11-b149-7b6edf4c4b70 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:14.032886 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-491e4fcd-7006-4a11-b149-7b6edf4c4b70 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:14.040673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-491e4fcd-7006-4a11-b149-7b6edf4c4b70 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:14.041347 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-491e4fcd-7006-4a11-b149-7b6edf4c4b70 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:14.041840 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-491e4fcd-7006-4a11-b149-7b6edf4c4b70 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:14.042611 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-491e4fcd-7006-4a11-b149-7b6edf4c4b70 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:14.043326 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-491e4fcd-7006-4a11-b149-7b6edf4c4b70 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:14.043758 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-491e4fcd-7006-4a11-b149-7b6edf4c4b70 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:14.138496 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-491e4fcd-7006-4a11-b149-7b6edf4c4b70 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:14.146108 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-491e4fcd-7006-4a11-b149-7b6edf4c4b70 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1295 microversion: 2.1 time: 0.117782 Sep 09 13:20:14.146843 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 412/822] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:14 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1295 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:14.251701 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f9873b84-121e-485d-829d-e8c68fab62ac tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:14.252555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f9873b84-121e-485d-829d-e8c68fab62ac tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:14.266311 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:14.269102 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f9873b84-121e-485d-829d-e8c68fab62ac tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:14.269810 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f9873b84-121e-485d-829d-e8c68fab62ac tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:14.270237 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f9873b84-121e-485d-829d-e8c68fab62ac tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:14.270946 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f9873b84-121e-485d-829d-e8c68fab62ac tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:14.271657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f9873b84-121e-485d-829d-e8c68fab62ac tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:14.272083 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f9873b84-121e-485d-829d-e8c68fab62ac tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:14.412862 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-989b85ce-076a-4f15-9984-c3e059036263 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:14.413945 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-989b85ce-076a-4f15-9984-c3e059036263 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] [instance: ff665b2c-17b1-41cb-b909-b7dd0e9646bb] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:14.421065 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-989b85ce-076a-4f15-9984-c3e059036263 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:14.422017 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-989b85ce-076a-4f15-9984-c3e059036263 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:14.422692 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-989b85ce-076a-4f15-9984-c3e059036263 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:14.423653 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-989b85ce-076a-4f15-9984-c3e059036263 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:14.424354 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-989b85ce-076a-4f15-9984-c3e059036263 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:14.424929 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-989b85ce-076a-4f15-9984-c3e059036263 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:14.440609 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-989b85ce-076a-4f15-9984-c3e059036263 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] HTTP exception thrown: Instance ff665b2c-17b1-41cb-b909-b7dd0e9646bb could not be found. Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-989b85ce-076a-4f15-9984-c3e059036263 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Request method failure captured: Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb HTTP/1.1 Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzzw57pFEwmYDQRMBD9AY0_bAnFF5qDADmm-dRNDaAOtnlGBpFAXbxsh4SkXA6xlz0jmmYC7AhIBpERLQgNealRmVsheIvfS_Dvsn6kqxsv2FHCyl1kzQMooncC0ixcWk5nsa0qjJQX2rVfEuX4VyEE2ggZsocdnfz2ZPZU-V1dGV2E Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 345a9eb6369c43a681649f1bb55ce60c Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesSnapshotTestJSON-112423045 Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:20:14.442807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:20:14.444546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/345a9eb6369c43a681649f1bb55ce60c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/345a9eb6369c43a681649f1bb55ce60c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/345a9eb6369c43a681649f1bb55ce60c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_345a9eb6369c43a681649f1bb55ce60c", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:20:14.444546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesSnapshotTestJSON-112423045 Sep 09 13:20:14.444546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 345a9eb6369c43a681649f1bb55ce60c Sep 09 13:20:14.444546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-112423045 Sep 09 13:20:14.444546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesSnapshotTestJSON-112423045-project Sep 09 13:20:14.444546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:20:14.444546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:20:14.444546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: 41ec6426ddf640389083cc61e948d31f Sep 09 13:20:14.444546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesSnapshotTestJSON-112423045-project Sep 09 13:20:14.444546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:20:14.444546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance ff665b2c-17b1-41cb-b909-b7dd0e9646bb could not be found. Sep 09 13:20:14.444546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': 'ff665b2c-17b1-41cb-b909-b7dd0e9646bb'} Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff665b2c-17b1-41cb-b909-b7dd0e9646bb could not be found. Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:20:14.445485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff665b2c-17b1-41cb-b909-b7dd0e9646bb could not be found. Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff665b2c-17b1-41cb-b909-b7dd0e9646bb could not be found. Sep 09 13:20:14.448059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:14.450791 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-989b85ce-076a-4f15-9984-c3e059036263 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] Returning 404 to user: Instance ff665b2c-17b1-41cb-b909-b7dd0e9646bb could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:20:14.451893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-989b85ce-076a-4f15-9984-c3e059036263 tempest-VolumesSnapshotTestJSON-112423045 tempest-VolumesSnapshotTestJSON-112423045-project] 10.222.0.17 "GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb" status: 404 len: 111 microversion: 2.1 time: 0.044801 Sep 09 13:20:14.452481 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 413/823] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:14 2022] GET /compute/v2.1/servers/ff665b2c-17b1-41cb-b909-b7dd0e9646bb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:20:14.693166 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f9873b84-121e-485d-829d-e8c68fab62ac tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:14.737913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f9873b84-121e-485d-829d-e8c68fab62ac tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.490394 Sep 09 13:20:14.743389 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 411/824] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:14 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:15.086861 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-2a6f229a-58c9-410a-bbd1-99c2b3789dcb req-de50424d-d436-4cd3-a557-0bd4cc46cbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d890866b-c7c2-4bee-89d9-76377b78b4ba", "tag": "68d9165e-613f-4a10-a059-f438ba96366a"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:20:15.097313 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2a6f229a-58c9-410a-bbd1-99c2b3789dcb req-de50424d-d436-4cd3-a557-0bd4cc46cbe4 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:15.097939 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2a6f229a-58c9-410a-bbd1-99c2b3789dcb req-de50424d-d436-4cd3-a557-0bd4cc46cbe4 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:15.098474 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-2a6f229a-58c9-410a-bbd1-99c2b3789dcb req-de50424d-d436-4cd3-a557-0bd4cc46cbe4 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:15.113786 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-2a6f229a-58c9-410a-bbd1-99c2b3789dcb req-de50424d-d436-4cd3-a557-0bd4cc46cbe4 service nova] Creating event network-changed:68d9165e-613f-4a10-a059-f438ba96366a for instance d890866b-c7c2-4bee-89d9-76377b78b4ba on hv-cinder-83124 Sep 09 13:20:15.118587 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-2a6f229a-58c9-410a-bbd1-99c2b3789dcb req-de50424d-d436-4cd3-a557-0bd4cc46cbe4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036120 Sep 09 13:20:15.120307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 414/825] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:20:15.170097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-11fe58ca-239e-4831-8589-921936dfb8df tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:15.170719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-11fe58ca-239e-4831-8589-921936dfb8df tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:15.176668 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11fe58ca-239e-4831-8589-921936dfb8df tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:15.177164 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11fe58ca-239e-4831-8589-921936dfb8df tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:15.177605 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11fe58ca-239e-4831-8589-921936dfb8df tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:15.178302 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11fe58ca-239e-4831-8589-921936dfb8df tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:15.178763 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11fe58ca-239e-4831-8589-921936dfb8df tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:15.179229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-11fe58ca-239e-4831-8589-921936dfb8df tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:15.312359 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-11fe58ca-239e-4831-8589-921936dfb8df tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:15.321326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-11fe58ca-239e-4831-8589-921936dfb8df tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1362 microversion: 2.1 time: 0.155458 Sep 09 13:20:15.322504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 412/826] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:15 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:15.768568 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e0c28109-268f-4e00-843c-cfc1a90d2a18 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:15.769197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e0c28109-268f-4e00-843c-cfc1a90d2a18 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:15.776052 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0c28109-268f-4e00-843c-cfc1a90d2a18 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:15.776641 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0c28109-268f-4e00-843c-cfc1a90d2a18 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:15.777073 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0c28109-268f-4e00-843c-cfc1a90d2a18 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:15.777758 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0c28109-268f-4e00-843c-cfc1a90d2a18 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:15.778209 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0c28109-268f-4e00-843c-cfc1a90d2a18 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:15.778628 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e0c28109-268f-4e00-843c-cfc1a90d2a18 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:15.922071 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e0c28109-268f-4e00-843c-cfc1a90d2a18 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:15.930428 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e0c28109-268f-4e00-843c-cfc1a90d2a18 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.166065 Sep 09 13:20:15.930997 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 415/827] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:15 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:16.344420 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-79855d0b-bff9-4092-97c4-77845ceabe30 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:16.345035 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-79855d0b-bff9-4092-97c4-77845ceabe30 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:16.350999 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79855d0b-bff9-4092-97c4-77845ceabe30 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:16.351510 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79855d0b-bff9-4092-97c4-77845ceabe30 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:16.351952 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79855d0b-bff9-4092-97c4-77845ceabe30 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:16.352639 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79855d0b-bff9-4092-97c4-77845ceabe30 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:16.353259 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79855d0b-bff9-4092-97c4-77845ceabe30 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:16.353540 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79855d0b-bff9-4092-97c4-77845ceabe30 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:16.487477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-79855d0b-bff9-4092-97c4-77845ceabe30 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:16.495928 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-79855d0b-bff9-4092-97c4-77845ceabe30 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1362 microversion: 2.1 time: 0.155624 Sep 09 13:20:16.496482 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 413/828] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:16 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:16.953191 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5c3cf37d-b7cc-4b0e-89ca-0388adb25e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:16.953798 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5c3cf37d-b7cc-4b0e-89ca-0388adb25e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:16.960326 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c3cf37d-b7cc-4b0e-89ca-0388adb25e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:16.960803 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c3cf37d-b7cc-4b0e-89ca-0388adb25e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:16.961231 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c3cf37d-b7cc-4b0e-89ca-0388adb25e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:16.961937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c3cf37d-b7cc-4b0e-89ca-0388adb25e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:16.962381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c3cf37d-b7cc-4b0e-89ca-0388adb25e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:16.963318 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5c3cf37d-b7cc-4b0e-89ca-0388adb25e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:17.114252 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5c3cf37d-b7cc-4b0e-89ca-0388adb25e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:17.117852 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:17.123841 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5c3cf37d-b7cc-4b0e-89ca-0388adb25e42 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.174502 Sep 09 13:20:17.124399 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 416/829] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:16 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:17.517935 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5bf1c796-625d-4240-9114-cbfdac34d046 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:17.518542 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5bf1c796-625d-4240-9114-cbfdac34d046 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:17.525631 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5bf1c796-625d-4240-9114-cbfdac34d046 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:17.526392 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5bf1c796-625d-4240-9114-cbfdac34d046 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:17.526822 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5bf1c796-625d-4240-9114-cbfdac34d046 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:17.527530 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5bf1c796-625d-4240-9114-cbfdac34d046 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:17.527985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5bf1c796-625d-4240-9114-cbfdac34d046 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:17.528404 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5bf1c796-625d-4240-9114-cbfdac34d046 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:17.659834 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5bf1c796-625d-4240-9114-cbfdac34d046 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:17.667496 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5bf1c796-625d-4240-9114-cbfdac34d046 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1362 microversion: 2.1 time: 0.153380 Sep 09 13:20:17.668053 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 414/830] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:17 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:18.146594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fdf00291-0a35-4fbe-a070-e1623fa41df2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:18.147277 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fdf00291-0a35-4fbe-a070-e1623fa41df2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:18.155675 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdf00291-0a35-4fbe-a070-e1623fa41df2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:18.156213 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdf00291-0a35-4fbe-a070-e1623fa41df2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:18.156644 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdf00291-0a35-4fbe-a070-e1623fa41df2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:18.157326 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdf00291-0a35-4fbe-a070-e1623fa41df2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:18.157767 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdf00291-0a35-4fbe-a070-e1623fa41df2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:18.158180 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fdf00291-0a35-4fbe-a070-e1623fa41df2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:18.298536 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fdf00291-0a35-4fbe-a070-e1623fa41df2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:18.307134 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fdf00291-0a35-4fbe-a070-e1623fa41df2 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.164324 Sep 09 13:20:18.307701 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 417/831] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:18 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:18.689743 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0bc4a907-0d32-4d07-ba2b-e195bd5aebed tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:18.690354 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0bc4a907-0d32-4d07-ba2b-e195bd5aebed tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:18.696796 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0bc4a907-0d32-4d07-ba2b-e195bd5aebed tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:18.697285 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0bc4a907-0d32-4d07-ba2b-e195bd5aebed tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:18.697711 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0bc4a907-0d32-4d07-ba2b-e195bd5aebed tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:18.698431 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0bc4a907-0d32-4d07-ba2b-e195bd5aebed tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:18.698884 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0bc4a907-0d32-4d07-ba2b-e195bd5aebed tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:18.699335 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0bc4a907-0d32-4d07-ba2b-e195bd5aebed tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:18.825925 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0bc4a907-0d32-4d07-ba2b-e195bd5aebed tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:18.833425 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0bc4a907-0d32-4d07-ba2b-e195bd5aebed tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1362 microversion: 2.1 time: 0.147607 Sep 09 13:20:18.833984 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 415/832] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:18 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:19.329713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e53db2d1-197f-4c35-9d41-2f2093f19077 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:19.330433 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e53db2d1-197f-4c35-9d41-2f2093f19077 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:19.336847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53db2d1-197f-4c35-9d41-2f2093f19077 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:19.337332 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53db2d1-197f-4c35-9d41-2f2093f19077 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:19.337980 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53db2d1-197f-4c35-9d41-2f2093f19077 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:19.338670 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53db2d1-197f-4c35-9d41-2f2093f19077 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:19.339142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53db2d1-197f-4c35-9d41-2f2093f19077 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:19.339563 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53db2d1-197f-4c35-9d41-2f2093f19077 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:19.354455 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:19.500082 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=12 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:19.570662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e53db2d1-197f-4c35-9d41-2f2093f19077 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:19.579612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e53db2d1-197f-4c35-9d41-2f2093f19077 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1758 microversion: 2.1 time: 0.253741 Sep 09 13:20:19.580192 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 418/833] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:19 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1758 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:19.857132 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4a3fd100-ccb0-46c0-adb1-6f9ee2ea76b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:19.857774 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4a3fd100-ccb0-46c0-adb1-6f9ee2ea76b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:19.864590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a3fd100-ccb0-46c0-adb1-6f9ee2ea76b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:19.865015 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a3fd100-ccb0-46c0-adb1-6f9ee2ea76b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:19.865451 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a3fd100-ccb0-46c0-adb1-6f9ee2ea76b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:19.866160 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a3fd100-ccb0-46c0-adb1-6f9ee2ea76b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:19.866655 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a3fd100-ccb0-46c0-adb1-6f9ee2ea76b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:19.867097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a3fd100-ccb0-46c0-adb1-6f9ee2ea76b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:20.003725 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4a3fd100-ccb0-46c0-adb1-6f9ee2ea76b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:20.011310 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4a3fd100-ccb0-46c0-adb1-6f9ee2ea76b3 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1362 microversion: 2.1 time: 0.158810 Sep 09 13:20:20.011867 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 416/834] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:19 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:20.603291 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-24cd63ee-9834-4b46-83fa-e097c678d315 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:20.604403 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-24cd63ee-9834-4b46-83fa-e097c678d315 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:20.611606 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24cd63ee-9834-4b46-83fa-e097c678d315 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:20.612519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24cd63ee-9834-4b46-83fa-e097c678d315 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:20.612519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24cd63ee-9834-4b46-83fa-e097c678d315 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:20.613177 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24cd63ee-9834-4b46-83fa-e097c678d315 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:20.613626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24cd63ee-9834-4b46-83fa-e097c678d315 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:20.614041 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-24cd63ee-9834-4b46-83fa-e097c678d315 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:20.760407 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-24cd63ee-9834-4b46-83fa-e097c678d315 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:20.768685 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-24cd63ee-9834-4b46-83fa-e097c678d315 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1761 microversion: 2.1 time: 0.169292 Sep 09 13:20:20.769249 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 419/835] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:20 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1761 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:21.034490 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8fc0a396-79d1-43fd-8689-f27628b05b91 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:21.035035 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8fc0a396-79d1-43fd-8689-f27628b05b91 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:21.042007 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fc0a396-79d1-43fd-8689-f27628b05b91 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:21.042499 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fc0a396-79d1-43fd-8689-f27628b05b91 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:21.042936 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fc0a396-79d1-43fd-8689-f27628b05b91 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:21.043651 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fc0a396-79d1-43fd-8689-f27628b05b91 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:21.044111 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fc0a396-79d1-43fd-8689-f27628b05b91 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:21.044537 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8fc0a396-79d1-43fd-8689-f27628b05b91 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:21.063780 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:21.176115 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8fc0a396-79d1-43fd-8689-f27628b05b91 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:21.184518 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8fc0a396-79d1-43fd-8689-f27628b05b91 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1362 microversion: 2.1 time: 0.154023 Sep 09 13:20:21.185079 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 417/836] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:21 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:21.271270 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-1e975f49-15ce-4614-bd4c-2f931656827a req-eecb3c74-2a03-4f71-b617-e384208c1826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d890866b-c7c2-4bee-89d9-76377b78b4ba", "name": "network-vif-plugged", "status": "completed", "tag": "68d9165e-613f-4a10-a059-f438ba96366a"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:20:21.276963 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:21.283399 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1e975f49-15ce-4614-bd4c-2f931656827a req-eecb3c74-2a03-4f71-b617-e384208c1826 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:21.283967 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1e975f49-15ce-4614-bd4c-2f931656827a req-eecb3c74-2a03-4f71-b617-e384208c1826 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:21.284393 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-1e975f49-15ce-4614-bd4c-2f931656827a req-eecb3c74-2a03-4f71-b617-e384208c1826 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:21.297403 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-1e975f49-15ce-4614-bd4c-2f931656827a req-eecb3c74-2a03-4f71-b617-e384208c1826 service nova] Creating event network-vif-plugged:68d9165e-613f-4a10-a059-f438ba96366a for instance d890866b-c7c2-4bee-89d9-76377b78b4ba on hv-cinder-83124 Sep 09 13:20:21.302871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-1e975f49-15ce-4614-bd4c-2f931656827a req-eecb3c74-2a03-4f71-b617-e384208c1826 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035306 Sep 09 13:20:21.303512 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 420/837] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:20:22.208015 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0fdc6acc-6a73-4dfa-aa32-fa108d6f2817 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:22.208649 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0fdc6acc-6a73-4dfa-aa32-fa108d6f2817 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:22.215300 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0fdc6acc-6a73-4dfa-aa32-fa108d6f2817 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:22.215786 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0fdc6acc-6a73-4dfa-aa32-fa108d6f2817 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:22.216220 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0fdc6acc-6a73-4dfa-aa32-fa108d6f2817 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:22.216901 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0fdc6acc-6a73-4dfa-aa32-fa108d6f2817 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:22.217354 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0fdc6acc-6a73-4dfa-aa32-fa108d6f2817 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:22.217808 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0fdc6acc-6a73-4dfa-aa32-fa108d6f2817 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:22.349290 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0fdc6acc-6a73-4dfa-aa32-fa108d6f2817 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:22.357870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0fdc6acc-6a73-4dfa-aa32-fa108d6f2817 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1362 microversion: 2.1 time: 0.153695 Sep 09 13:20:22.358435 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 418/838] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:22 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:23.382197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-707f4da3-8ff2-48e8-b517-de852f5c795a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:23.382903 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-707f4da3-8ff2-48e8-b517-de852f5c795a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:23.389888 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-707f4da3-8ff2-48e8-b517-de852f5c795a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:23.390363 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-707f4da3-8ff2-48e8-b517-de852f5c795a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:23.390790 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-707f4da3-8ff2-48e8-b517-de852f5c795a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:23.391499 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-707f4da3-8ff2-48e8-b517-de852f5c795a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:23.391947 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-707f4da3-8ff2-48e8-b517-de852f5c795a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:23.392370 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-707f4da3-8ff2-48e8-b517-de852f5c795a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:23.524403 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-707f4da3-8ff2-48e8-b517-de852f5c795a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:23.532835 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-707f4da3-8ff2-48e8-b517-de852f5c795a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1546 microversion: 2.1 time: 0.155391 Sep 09 13:20:23.533392 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 421/839] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:23 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:23.555586 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-73c4681a-6190-4866-b8be-1c0079affa06 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:23.556109 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-73c4681a-6190-4866-b8be-1c0079affa06 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:23.562869 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73c4681a-6190-4866-b8be-1c0079affa06 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:23.563383 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73c4681a-6190-4866-b8be-1c0079affa06 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:23.563820 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73c4681a-6190-4866-b8be-1c0079affa06 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:23.565322 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73c4681a-6190-4866-b8be-1c0079affa06 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:23.565798 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73c4681a-6190-4866-b8be-1c0079affa06 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:23.566231 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-73c4681a-6190-4866-b8be-1c0079affa06 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:23.644077 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-73c4681a-6190-4866-b8be-1c0079affa06 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092282 Sep 09 13:20:23.644669 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 419/840] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 13:20:23 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:20:24.580392 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-79e5fc82-3e8e-4b45-8088-2b4bae11a827 req-37406eff-8dae-4d0c-bd18-1ab3c061822c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d890866b-c7c2-4bee-89d9-76377b78b4ba", "tag": "68d9165e-613f-4a10-a059-f438ba96366a"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:20:24.590764 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-79e5fc82-3e8e-4b45-8088-2b4bae11a827 req-37406eff-8dae-4d0c-bd18-1ab3c061822c service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:24.591277 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-79e5fc82-3e8e-4b45-8088-2b4bae11a827 req-37406eff-8dae-4d0c-bd18-1ab3c061822c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:24.591707 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-79e5fc82-3e8e-4b45-8088-2b4bae11a827 req-37406eff-8dae-4d0c-bd18-1ab3c061822c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:24.603791 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-79e5fc82-3e8e-4b45-8088-2b4bae11a827 req-37406eff-8dae-4d0c-bd18-1ab3c061822c service nova] Creating event network-changed:68d9165e-613f-4a10-a059-f438ba96366a for instance d890866b-c7c2-4bee-89d9-76377b78b4ba on hv-cinder-83124 Sep 09 13:20:24.609062 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-79e5fc82-3e8e-4b45-8088-2b4bae11a827 req-37406eff-8dae-4d0c-bd18-1ab3c061822c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032379 Sep 09 13:20:24.609930 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 422/841] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:20:43.292843 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=17 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:43.293542 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=12 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:43.298717 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4e136a79-d881-4007-b0c1-dd4703936c8e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:43.299241 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4e136a79-d881-4007-b0c1-dd4703936c8e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:43.305955 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e136a79-d881-4007-b0c1-dd4703936c8e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:43.306436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e136a79-d881-4007-b0c1-dd4703936c8e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:43.306871 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e136a79-d881-4007-b0c1-dd4703936c8e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:43.307588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e136a79-d881-4007-b0c1-dd4703936c8e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:43.308039 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e136a79-d881-4007-b0c1-dd4703936c8e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:43.308459 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4e136a79-d881-4007-b0c1-dd4703936c8e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:43.388029 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-4e136a79-d881-4007-b0c1-dd4703936c8e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lazy-loading 'services' on Instance uuid 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:20:43.461110 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4e136a79-d881-4007-b0c1-dd4703936c8e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-volume_attachments/47a7b876-b956-4805-a76b-ac86fdc63886" status: 202 len: 0 microversion: 2.1 time: 0.169756 Sep 09 13:20:43.461812 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 420/842] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 13:20:43 2022] DELETE /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-volume_attachments/47a7b876-b956-4805-a76b-ac86fdc63886 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:20:43.468616 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=5 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:43.469483 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=28 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:43.473763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e9a6836d-08ac-4cf4-8d27-e1f514f41681 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:43.475955 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e9a6836d-08ac-4cf4-8d27-e1f514f41681 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:43.483654 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9a6836d-08ac-4cf4-8d27-e1f514f41681 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:43.484188 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9a6836d-08ac-4cf4-8d27-e1f514f41681 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:43.484581 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9a6836d-08ac-4cf4-8d27-e1f514f41681 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:43.485365 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9a6836d-08ac-4cf4-8d27-e1f514f41681 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:43.485824 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9a6836d-08ac-4cf4-8d27-e1f514f41681 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:43.486249 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e9a6836d-08ac-4cf4-8d27-e1f514f41681 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:43.516959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e9a6836d-08ac-4cf4-8d27-e1f514f41681 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050401 Sep 09 13:20:43.517515 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 423/843] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:20:43 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:20:44.530394 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4367fde5-33b0-4dc4-a56d-9fca7a182355 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:44.532709 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4367fde5-33b0-4dc4-a56d-9fca7a182355 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:44.538862 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4367fde5-33b0-4dc4-a56d-9fca7a182355 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:44.539389 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4367fde5-33b0-4dc4-a56d-9fca7a182355 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:44.539834 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4367fde5-33b0-4dc4-a56d-9fca7a182355 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:44.540559 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4367fde5-33b0-4dc4-a56d-9fca7a182355 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:44.541021 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4367fde5-33b0-4dc4-a56d-9fca7a182355 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:44.541449 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4367fde5-33b0-4dc4-a56d-9fca7a182355 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:44.571156 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4367fde5-33b0-4dc4-a56d-9fca7a182355 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045714 Sep 09 13:20:44.571703 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 421/844] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:20:44 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:20:44.659612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f633832-e9e9-4e4e-9d14-e3208ef5d47e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:44.660123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5f633832-e9e9-4e4e-9d14-e3208ef5d47e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:44.666425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f633832-e9e9-4e4e-9d14-e3208ef5d47e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:44.666899 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f633832-e9e9-4e4e-9d14-e3208ef5d47e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:44.667376 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f633832-e9e9-4e4e-9d14-e3208ef5d47e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:44.668058 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f633832-e9e9-4e4e-9d14-e3208ef5d47e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:44.668507 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f633832-e9e9-4e4e-9d14-e3208ef5d47e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:44.668929 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f633832-e9e9-4e4e-9d14-e3208ef5d47e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:44.695539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5f633832-e9e9-4e4e-9d14-e3208ef5d47e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:20:44.770295 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f633832-e9e9-4e4e-9d14-e3208ef5d47e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 204 len: 0 microversion: 2.1 time: 0.114240 Sep 09 13:20:44.770879 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 424/845] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:20:44 2022] DELETE /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:20:44.779384 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d1aa31b4-d658-4f24-a080-3aec9091e13d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:44.780001 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d1aa31b4-d658-4f24-a080-3aec9091e13d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:44.786009 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1aa31b4-d658-4f24-a080-3aec9091e13d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:44.786431 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1aa31b4-d658-4f24-a080-3aec9091e13d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:44.786872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1aa31b4-d658-4f24-a080-3aec9091e13d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:44.787606 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1aa31b4-d658-4f24-a080-3aec9091e13d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:44.788063 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1aa31b4-d658-4f24-a080-3aec9091e13d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:44.788482 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1aa31b4-d658-4f24-a080-3aec9091e13d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:44.917468 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d1aa31b4-d658-4f24-a080-3aec9091e13d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:44.925901 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d1aa31b4-d658-4f24-a080-3aec9091e13d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1687 microversion: 2.1 time: 0.150987 Sep 09 13:20:44.926461 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 422/846] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:44 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:45.949412 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-85ae18e4-3f29-4005-ace5-0da48a20bacc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:45.950141 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-85ae18e4-3f29-4005-ace5-0da48a20bacc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:45.957229 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85ae18e4-3f29-4005-ace5-0da48a20bacc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:45.957712 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85ae18e4-3f29-4005-ace5-0da48a20bacc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:45.958143 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85ae18e4-3f29-4005-ace5-0da48a20bacc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:45.958827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85ae18e4-3f29-4005-ace5-0da48a20bacc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:45.959313 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85ae18e4-3f29-4005-ace5-0da48a20bacc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:45.959737 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-85ae18e4-3f29-4005-ace5-0da48a20bacc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:46.091755 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-85ae18e4-3f29-4005-ace5-0da48a20bacc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:46.099504 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-85ae18e4-3f29-4005-ace5-0da48a20bacc tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1687 microversion: 2.1 time: 0.154321 Sep 09 13:20:46.100080 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 425/847] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:45 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:46.554040 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4b4ed157-d8f0-4bf4-9302-809021b20406 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:46.554614 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4b4ed157-d8f0-4bf4-9302-809021b20406 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:46.560503 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b4ed157-d8f0-4bf4-9302-809021b20406 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:46.561023 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b4ed157-d8f0-4bf4-9302-809021b20406 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:46.561459 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b4ed157-d8f0-4bf4-9302-809021b20406 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:46.562169 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b4ed157-d8f0-4bf4-9302-809021b20406 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:46.562709 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b4ed157-d8f0-4bf4-9302-809021b20406 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:46.563171 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4b4ed157-d8f0-4bf4-9302-809021b20406 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:46.593369 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4b4ed157-d8f0-4bf4-9302-809021b20406 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-volume_attachments/51ef9e0b-7a53-437c-a631-ca5155edb1d4" status: 200 len: 194 microversion: 2.20 time: 0.043222 Sep 09 13:20:46.594152 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 423/848] 10.222.0.17 () {60 vars in 1454 bytes} [Fri Sep 9 13:20:46 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-volume_attachments/51ef9e0b-7a53-437c-a631-ca5155edb1d4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:20:46.662401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ac8687e-21db-40ca-9478-349e7d1639ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:46.662890 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9ac8687e-21db-40ca-9478-349e7d1639ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:46.668928 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac8687e-21db-40ca-9478-349e7d1639ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:46.669403 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac8687e-21db-40ca-9478-349e7d1639ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:46.670702 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac8687e-21db-40ca-9478-349e7d1639ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:46.671505 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac8687e-21db-40ca-9478-349e7d1639ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:46.671955 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac8687e-21db-40ca-9478-349e7d1639ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:46.672371 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ac8687e-21db-40ca-9478-349e7d1639ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:46.750656 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-9ac8687e-21db-40ca-9478-349e7d1639ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lazy-loading 'services' on Instance uuid 9f961e5a-6c12-48b6-ae52-e61b993275b3 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:20:46.821621 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ac8687e-21db-40ca-9478-349e7d1639ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-volume_attachments/51ef9e0b-7a53-437c-a631-ca5155edb1d4" status: 202 len: 0 microversion: 2.20 time: 0.163214 Sep 09 13:20:46.822205 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 426/849] 10.222.0.17 () {60 vars in 1457 bytes} [Fri Sep 9 13:20:46 2022] DELETE /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-volume_attachments/51ef9e0b-7a53-437c-a631-ca5155edb1d4 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:20:46.831227 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6b304b6a-2d06-453c-89e0-c3140cd5b6c0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:46.833523 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6b304b6a-2d06-453c-89e0-c3140cd5b6c0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:46.839373 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6b304b6a-2d06-453c-89e0-c3140cd5b6c0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:46.839850 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6b304b6a-2d06-453c-89e0-c3140cd5b6c0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:46.840279 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6b304b6a-2d06-453c-89e0-c3140cd5b6c0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:46.840951 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6b304b6a-2d06-453c-89e0-c3140cd5b6c0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:46.841398 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6b304b6a-2d06-453c-89e0-c3140cd5b6c0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:46.842470 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-6b304b6a-2d06-453c-89e0-c3140cd5b6c0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:46.871319 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6b304b6a-2d06-453c-89e0-c3140cd5b6c0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043788 Sep 09 13:20:46.871855 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 424/850] 10.222.0.17 () {60 vars in 1343 bytes} [Fri Sep 9 13:20:46 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:20:47.124783 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7a10f06f-fa36-454c-9d97-1193faa4ffb1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:47.125408 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7a10f06f-fa36-454c-9d97-1193faa4ffb1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:47.131605 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a10f06f-fa36-454c-9d97-1193faa4ffb1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:47.132088 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a10f06f-fa36-454c-9d97-1193faa4ffb1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:47.132521 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a10f06f-fa36-454c-9d97-1193faa4ffb1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:47.133206 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a10f06f-fa36-454c-9d97-1193faa4ffb1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:47.133661 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a10f06f-fa36-454c-9d97-1193faa4ffb1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:47.134079 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7a10f06f-fa36-454c-9d97-1193faa4ffb1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:47.265755 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7a10f06f-fa36-454c-9d97-1193faa4ffb1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:47.273306 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7a10f06f-fa36-454c-9d97-1193faa4ffb1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1687 microversion: 2.1 time: 0.153831 Sep 09 13:20:47.273861 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 427/851] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:47 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:47.883991 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bdf05407-ca5b-4859-99be-4f6d84e95588 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:47.886044 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bdf05407-ca5b-4859-99be-4f6d84e95588 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:47.893245 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdf05407-ca5b-4859-99be-4f6d84e95588 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:47.893719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdf05407-ca5b-4859-99be-4f6d84e95588 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:47.894144 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdf05407-ca5b-4859-99be-4f6d84e95588 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:47.894821 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdf05407-ca5b-4859-99be-4f6d84e95588 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:47.895295 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdf05407-ca5b-4859-99be-4f6d84e95588 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:47.895710 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bdf05407-ca5b-4859-99be-4f6d84e95588 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:47.924481 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bdf05407-ca5b-4859-99be-4f6d84e95588 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044578 Sep 09 13:20:47.925037 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 425/852] 10.222.0.17 () {60 vars in 1343 bytes} [Fri Sep 9 13:20:47 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:20:48.297067 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28286160-704b-4b35-b5bd-28cdc6ea1c35 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:48.297672 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-28286160-704b-4b35-b5bd-28cdc6ea1c35 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:48.305273 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28286160-704b-4b35-b5bd-28cdc6ea1c35 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:48.305756 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28286160-704b-4b35-b5bd-28cdc6ea1c35 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:48.306185 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28286160-704b-4b35-b5bd-28cdc6ea1c35 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:48.306872 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28286160-704b-4b35-b5bd-28cdc6ea1c35 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:48.307360 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28286160-704b-4b35-b5bd-28cdc6ea1c35 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:48.307791 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28286160-704b-4b35-b5bd-28cdc6ea1c35 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:48.436865 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-28286160-704b-4b35-b5bd-28cdc6ea1c35 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:48.444486 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-28286160-704b-4b35-b5bd-28cdc6ea1c35 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1687 microversion: 2.1 time: 0.151884 Sep 09 13:20:48.445045 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 428/853] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:48 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:48.937349 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-39b784d2-7f83-4564-866f-adc4909f5f5c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:48.939544 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-39b784d2-7f83-4564-866f-adc4909f5f5c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:48.945835 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-39b784d2-7f83-4564-866f-adc4909f5f5c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:48.946313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-39b784d2-7f83-4564-866f-adc4909f5f5c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:48.946750 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-39b784d2-7f83-4564-866f-adc4909f5f5c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:48.947527 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-39b784d2-7f83-4564-866f-adc4909f5f5c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:48.947980 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-39b784d2-7f83-4564-866f-adc4909f5f5c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:48.948405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-39b784d2-7f83-4564-866f-adc4909f5f5c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:48.977869 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-39b784d2-7f83-4564-866f-adc4909f5f5c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044552 Sep 09 13:20:48.978412 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 426/854] 10.222.0.17 () {60 vars in 1343 bytes} [Fri Sep 9 13:20:48 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:20:49.468473 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-853c3304-5831-4497-aa60-0142c8bb6da3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:49.469250 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-853c3304-5831-4497-aa60-0142c8bb6da3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:49.476943 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-853c3304-5831-4497-aa60-0142c8bb6da3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:49.477502 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-853c3304-5831-4497-aa60-0142c8bb6da3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:49.477999 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-853c3304-5831-4497-aa60-0142c8bb6da3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:49.478758 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-853c3304-5831-4497-aa60-0142c8bb6da3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:49.479322 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-853c3304-5831-4497-aa60-0142c8bb6da3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:49.479965 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-853c3304-5831-4497-aa60-0142c8bb6da3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:49.957993 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-853c3304-5831-4497-aa60-0142c8bb6da3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:49.966020 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-853c3304-5831-4497-aa60-0142c8bb6da3 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1687 microversion: 2.1 time: 0.502205 Sep 09 13:20:49.966523 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 429/855] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:49 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1687 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:49.989872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e76f0d1a-7933-41ce-9947-f5507fcba62b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:49.992099 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e76f0d1a-7933-41ce-9947-f5507fcba62b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:49.999243 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e76f0d1a-7933-41ce-9947-f5507fcba62b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:49.999740 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e76f0d1a-7933-41ce-9947-f5507fcba62b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:50.000184 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e76f0d1a-7933-41ce-9947-f5507fcba62b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:50.000879 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e76f0d1a-7933-41ce-9947-f5507fcba62b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:50.001335 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e76f0d1a-7933-41ce-9947-f5507fcba62b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:50.001765 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e76f0d1a-7933-41ce-9947-f5507fcba62b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:50.031568 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e76f0d1a-7933-41ce-9947-f5507fcba62b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045550 Sep 09 13:20:50.032136 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 427/856] 10.222.0.17 () {60 vars in 1343 bytes} [Fri Sep 9 13:20:49 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:50.096571 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b99a201f-96fc-43a3-bea6-2d341630d517 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:50.097065 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b99a201f-96fc-43a3-bea6-2d341630d517 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:50.102865 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b99a201f-96fc-43a3-bea6-2d341630d517 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:50.103376 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b99a201f-96fc-43a3-bea6-2d341630d517 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:50.103807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b99a201f-96fc-43a3-bea6-2d341630d517 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:50.104486 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b99a201f-96fc-43a3-bea6-2d341630d517 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:50.104930 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b99a201f-96fc-43a3-bea6-2d341630d517 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:50.105343 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b99a201f-96fc-43a3-bea6-2d341630d517 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:50.133135 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b99a201f-96fc-43a3-bea6-2d341630d517 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:20:50.214262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b99a201f-96fc-43a3-bea6-2d341630d517 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 204 len: 0 microversion: 2.20 time: 0.121116 Sep 09 13:20:50.215103 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 430/857] 10.222.0.17 () {60 vars in 1280 bytes} [Fri Sep 9 13:20:50 2022] DELETE /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 09 13:20:50.224040 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1f713a59-1642-4a5b-84c5-28c8403b0839 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:50.224575 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1f713a59-1642-4a5b-84c5-28c8403b0839 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:50.231348 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1f713a59-1642-4a5b-84c5-28c8403b0839 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:50.231861 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1f713a59-1642-4a5b-84c5-28c8403b0839 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:50.232924 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1f713a59-1642-4a5b-84c5-28c8403b0839 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:50.233713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1f713a59-1642-4a5b-84c5-28c8403b0839 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:50.234178 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1f713a59-1642-4a5b-84c5-28c8403b0839 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:50.234643 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1f713a59-1642-4a5b-84c5-28c8403b0839 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:50.374922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1f713a59-1642-4a5b-84c5-28c8403b0839 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:50.383710 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1f713a59-1642-4a5b-84c5-28c8403b0839 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:50.385162 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1f713a59-1642-4a5b-84c5-28c8403b0839 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:50.386327 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1f713a59-1642-4a5b-84c5-28c8403b0839 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.166333 Sep 09 13:20:50.386886 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 428/858] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:20:50 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:20:50.592596 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-b649470e-8c73-4d19-8494-f73fb9d11a0a req-f332fd3d-2739-424f-bdca-6ed853566223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8d3e22-93f3-4251-bbfc-8bd5c60cb875", "name": "network-vif-deleted", "tag": "b82ef3ba-9f78-4e05-830b-166b5fa60d7f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:20:50.602179 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b649470e-8c73-4d19-8494-f73fb9d11a0a req-f332fd3d-2739-424f-bdca-6ed853566223 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:50.602657 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b649470e-8c73-4d19-8494-f73fb9d11a0a req-f332fd3d-2739-424f-bdca-6ed853566223 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:50.603118 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-b649470e-8c73-4d19-8494-f73fb9d11a0a req-f332fd3d-2739-424f-bdca-6ed853566223 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:50.614633 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-b649470e-8c73-4d19-8494-f73fb9d11a0a req-f332fd3d-2739-424f-bdca-6ed853566223 service nova] Creating event network-vif-deleted:b82ef3ba-9f78-4e05-830b-166b5fa60d7f for instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 on hv-cinder-83124 Sep 09 13:20:50.619554 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-b649470e-8c73-4d19-8494-f73fb9d11a0a req-f332fd3d-2739-424f-bdca-6ed853566223 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031126 Sep 09 13:20:50.620146 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 431/859] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:20:50.989381 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e048211f-8f3c-4e5a-a2aa-fb927475c9b1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:50.989994 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e048211f-8f3c-4e5a-a2aa-fb927475c9b1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:50.996620 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e048211f-8f3c-4e5a-a2aa-fb927475c9b1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:50.997108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e048211f-8f3c-4e5a-a2aa-fb927475c9b1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:50.997563 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e048211f-8f3c-4e5a-a2aa-fb927475c9b1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:50.998916 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e048211f-8f3c-4e5a-a2aa-fb927475c9b1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:50.999401 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e048211f-8f3c-4e5a-a2aa-fb927475c9b1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:50.999822 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e048211f-8f3c-4e5a-a2aa-fb927475c9b1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:51.066367 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e048211f-8f3c-4e5a-a2aa-fb927475c9b1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:51.074433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e048211f-8f3c-4e5a-a2aa-fb927475c9b1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1620 microversion: 2.1 time: 0.088868 Sep 09 13:20:51.090168 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 429/860] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:50 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1620 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:51.414114 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ded2fc2-99a8-4599-9fa0-d166b0bdc5b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:51.414816 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9ded2fc2-99a8-4599-9fa0-d166b0bdc5b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:51.421995 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ded2fc2-99a8-4599-9fa0-d166b0bdc5b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:51.422536 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ded2fc2-99a8-4599-9fa0-d166b0bdc5b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:51.422970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ded2fc2-99a8-4599-9fa0-d166b0bdc5b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:51.423703 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ded2fc2-99a8-4599-9fa0-d166b0bdc5b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:51.424155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ded2fc2-99a8-4599-9fa0-d166b0bdc5b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:51.424576 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9ded2fc2-99a8-4599-9fa0-d166b0bdc5b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:51.562421 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9ded2fc2-99a8-4599-9fa0-d166b0bdc5b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:51.570922 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9ded2fc2-99a8-4599-9fa0-d166b0bdc5b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:51.572521 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9ded2fc2-99a8-4599-9fa0-d166b0bdc5b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:51.573759 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ded2fc2-99a8-4599-9fa0-d166b0bdc5b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.163991 Sep 09 13:20:51.574317 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 432/861] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:20:51 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:20:52.099460 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-4a17ce73-25fd-4bda-87bd-56cd25b0b288 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:52.100878 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-4a17ce73-25fd-4bda-87bd-56cd25b0b288 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:52.107347 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a17ce73-25fd-4bda-87bd-56cd25b0b288 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:52.108066 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a17ce73-25fd-4bda-87bd-56cd25b0b288 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:52.108546 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a17ce73-25fd-4bda-87bd-56cd25b0b288 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:52.109253 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a17ce73-25fd-4bda-87bd-56cd25b0b288 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:52.109705 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a17ce73-25fd-4bda-87bd-56cd25b0b288 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:52.110128 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a17ce73-25fd-4bda-87bd-56cd25b0b288 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:52.147370 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a17ce73-25fd-4bda-87bd-56cd25b0b288 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:52.147855 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a17ce73-25fd-4bda-87bd-56cd25b0b288 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:52.148286 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-4a17ce73-25fd-4bda-87bd-56cd25b0b288 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:52.148728 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-4a17ce73-25fd-4bda-87bd-56cd25b0b288 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lazy-loading 'fault' on Instance uuid 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:20:52.191906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-4a17ce73-25fd-4bda-87bd-56cd25b0b288 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:52.200174 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-4a17ce73-25fd-4bda-87bd-56cd25b0b288 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 200 len: 1334 microversion: 2.1 time: 0.104594 Sep 09 13:20:52.200735 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 430/862] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:52 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 1334 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:52.599835 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-39c9f3ec-a145-4b2b-b823-251f9ce9b38b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:52.600440 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-39c9f3ec-a145-4b2b-b823-251f9ce9b38b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:52.606558 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c9f3ec-a145-4b2b-b823-251f9ce9b38b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:52.608934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c9f3ec-a145-4b2b-b823-251f9ce9b38b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:52.610337 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c9f3ec-a145-4b2b-b823-251f9ce9b38b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:52.611384 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c9f3ec-a145-4b2b-b823-251f9ce9b38b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:52.612092 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c9f3ec-a145-4b2b-b823-251f9ce9b38b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:52.612718 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-39c9f3ec-a145-4b2b-b823-251f9ce9b38b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:52.926874 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-39c9f3ec-a145-4b2b-b823-251f9ce9b38b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:52.935026 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-39c9f3ec-a145-4b2b-b823-251f9ce9b38b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:52.936659 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-39c9f3ec-a145-4b2b-b823-251f9ce9b38b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:52.937820 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-39c9f3ec-a145-4b2b-b823-251f9ce9b38b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1723 microversion: 2.20 time: 0.341794 Sep 09 13:20:52.938390 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 433/863] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:20:52 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:20:53.224081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1f150b46-8e30-4268-936b-7ccdee0b1d8d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:53.224778 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1f150b46-8e30-4268-936b-7ccdee0b1d8d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:53.231204 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1f150b46-8e30-4268-936b-7ccdee0b1d8d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:53.231922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1f150b46-8e30-4268-936b-7ccdee0b1d8d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:53.232517 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1f150b46-8e30-4268-936b-7ccdee0b1d8d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:53.233276 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1f150b46-8e30-4268-936b-7ccdee0b1d8d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:53.233736 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1f150b46-8e30-4268-936b-7ccdee0b1d8d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:53.234168 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1f150b46-8e30-4268-936b-7ccdee0b1d8d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:53.255383 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-1f150b46-8e30-4268-936b-7ccdee0b1d8d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] HTTP exception thrown: Instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 could not be found. Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1f150b46-8e30-4268-936b-7ccdee0b1d8d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Request method failure captured: Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 HTTP/1.1 Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxMaP5VQ9Fa4ImIgAfQPE2uyEKzPqrSzG7jDqHVKheNPr4YU7dLoJPAu1rRTBsxWJj2PugBC5JGZ6kf7tsaYSTWABRQuj-o4spLAESfpGmqV5VvqtmG6FoGDvekFdSvHcYXGJy8g3zxH-DAzraEBEuS_8Rx758zmWkj4bVIt3J4Dcs Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 1eedefa6b656409f902d158e77d94aa0 Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:20:53.257059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:20:53.259944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1eedefa6b656409f902d158e77d94aa0", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:20:53.259944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:20:53.259944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 1eedefa6b656409f902d158e77d94aa0 Sep 09 13:20:53.259944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:20:53.259944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-ServerRescueNegativeTestJSON-819143313-project Sep 09 13:20:53.259944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:20:53.259944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:20:53.259944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: 21700a3c2ff24fc6a3bb5db8bf283f5c Sep 09 13:20:53.259944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-ServerRescueNegativeTestJSON-819143313-project Sep 09 13:20:53.259944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:20:53.259944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 could not be found. Sep 09 13:20:53.259944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '4f8d3e22-93f3-4251-bbfc-8bd5c60cb875'} Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 could not be found. Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:20:53.261484 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 could not be found. Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 could not be found. Sep 09 13:20:53.266588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:20:53.270606 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1f150b46-8e30-4268-936b-7ccdee0b1d8d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Returning 404 to user: Instance 4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:20:53.270606 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1f150b46-8e30-4268-936b-7ccdee0b1d8d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875" status: 404 len: 111 microversion: 2.1 time: 0.038359 Sep 09 13:20:53.270606 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 431/864] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:53 2022] GET /compute/v2.1/servers/4f8d3e22-93f3-4251-bbfc-8bd5c60cb875 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:20:53.272247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a86ce4e0-aa1b-4e2d-a801-3e9e881c0816 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '.version_select at 0x7fd4a516f0d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:53.300554 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a86ce4e0-aa1b-4e2d-a801-3e9e881c0816 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-322814798" status: 202 len: 0 microversion: 2.1 time: 0.035355 Sep 09 13:20:53.301070 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 434/865] 10.222.0.17 () {58 vars in 1218 bytes} [Fri Sep 9 13:20:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-322814798 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 13:20:53.373732 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-d218dbcd-95a0-4741-bce7-8b005e9e3fdc req-622fef90-8985-4cc6-b3cb-ceefefd4f0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f961e5a-6c12-48b6-ae52-e61b993275b3", "name": "network-vif-deleted", "tag": "b38055a2-318f-4ddd-8392-48b0e32eee23"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:20:53.387474 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-d218dbcd-95a0-4741-bce7-8b005e9e3fdc req-622fef90-8985-4cc6-b3cb-ceefefd4f0e4 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:53.388241 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-d218dbcd-95a0-4741-bce7-8b005e9e3fdc req-622fef90-8985-4cc6-b3cb-ceefefd4f0e4 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:53.389955 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-d218dbcd-95a0-4741-bce7-8b005e9e3fdc req-622fef90-8985-4cc6-b3cb-ceefefd4f0e4 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:53.406811 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-d218dbcd-95a0-4741-bce7-8b005e9e3fdc req-622fef90-8985-4cc6-b3cb-ceefefd4f0e4 service nova] Creating event network-vif-deleted:b38055a2-318f-4ddd-8392-48b0e32eee23 for instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 on hv-cinder-83124 Sep 09 13:20:53.412585 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-d218dbcd-95a0-4741-bce7-8b005e9e3fdc req-622fef90-8985-4cc6-b3cb-ceefefd4f0e4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046079 Sep 09 13:20:53.413610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 432/866] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:20:53.963989 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:53.964580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:53.971734 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:53.972226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:53.972660 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:53.973368 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:53.973943 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:53.974370 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:54.007478 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:54.007974 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:54.008619 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:54.009083 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lazy-loading 'fault' on Instance uuid 9f961e5a-6c12-48b6-ae52-e61b993275b3 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:20:54.074570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:54.084209 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:54.085870 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:54.087709 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-15eeb809-09cb-4a4c-aae3-2890b296a75c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 200 len: 1371 microversion: 2.20 time: 0.127422 Sep 09 13:20:54.103709 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 435/867] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:20:53 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 1371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:20:55.057934 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9f8c3fdb-891b-4581-892d-0742918633ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:55.058523 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9f8c3fdb-891b-4581-892d-0742918633ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:55.064840 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f8c3fdb-891b-4581-892d-0742918633ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:55.065331 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f8c3fdb-891b-4581-892d-0742918633ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:55.065772 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f8c3fdb-891b-4581-892d-0742918633ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:55.066465 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f8c3fdb-891b-4581-892d-0742918633ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:55.066924 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f8c3fdb-891b-4581-892d-0742918633ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:55.067385 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f8c3fdb-891b-4581-892d-0742918633ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:55.090785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9f8c3fdb-891b-4581-892d-0742918633ce tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/ips" status: 200 len: 150 microversion: 2.1 time: 0.197535 Sep 09 13:20:55.091365 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 433/868] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 13:20:54 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/ips => generated 150 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:20:55.113709 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-45c9fae9-4d6f-4798-a376-249296a6bc82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:55.114348 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-45c9fae9-4d6f-4798-a376-249296a6bc82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:55.120758 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45c9fae9-4d6f-4798-a376-249296a6bc82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:55.121510 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45c9fae9-4d6f-4798-a376-249296a6bc82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:55.121947 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45c9fae9-4d6f-4798-a376-249296a6bc82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:55.122662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45c9fae9-4d6f-4798-a376-249296a6bc82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:55.123236 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45c9fae9-4d6f-4798-a376-249296a6bc82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:55.123552 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-45c9fae9-4d6f-4798-a376-249296a6bc82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:55.137374 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-45c9fae9-4d6f-4798-a376-249296a6bc82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] HTTP exception thrown: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-45c9fae9-4d6f-4798-a376-249296a6bc82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Request method failure captured: Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 HTTP/1.1 Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzyuqbVZAIYx3LALMxK3qqTBAG_QaWkCxv0HvYuLxzMXc-r4JTi0LaP60g6RZWURnCyfrecXOYXASPbUSukuA49v8a5ecDvXCmNjGVaVgdgGbrYIyPMAaR-6rEUMzSzJHUb3VcuMjikme9MPNefa3WFYUOxfZDDcbJpO9fsqKknUNKE Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 92f354242a7b4ae4b774681eb633c2b2 Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:20:55.139666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:20:55.141488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_92f354242a7b4ae4b774681eb633c2b2", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:20:55.141488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:20:55.141488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 92f354242a7b4ae4b774681eb633c2b2 Sep 09 13:20:55.141488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:20:55.141488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeShelveTestJSON-1289054398-project Sep 09 13:20:55.141488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:20:55.141488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:20:55.141488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: ca9eb6b9dc6e409a954c7993ebe5a5c3 Sep 09 13:20:55.141488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289054398-project Sep 09 13:20:55.141488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:20:55.141488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:20:55.141488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '9f961e5a-6c12-48b6-ae52-e61b993275b3'} Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:20:55.142555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:20:55.144768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:20:55.146333 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-45c9fae9-4d6f-4798-a376-249296a6bc82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Returning 404 to user: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:20:55.146333 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-45c9fae9-4d6f-4798-a376-249296a6bc82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 404 len: 111 microversion: 2.20 time: 0.032594 Sep 09 13:20:55.147235 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 436/869] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:20:55 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:20:55.152962 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-487a8844-606e-475f-a062-0f3ba0a41f02 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '.version_select at 0x7fd4a1384dc0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:55.174057 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-487a8844-606e-475f-a062-0f3ba0a41f02 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-568301639" status: 204 len: 0 microversion: 2.20 time: 0.025396 Sep 09 13:20:55.174633 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 434/870] 10.222.0.17 () {60 vars in 1259 bytes} [Fri Sep 9 13:20:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-568301639 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 13:20:55.857106 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-78c9ffc7-9f55-412c-8e88-75a121e969e6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Action: 'create', calling method: .version_select at 0x7fd4a518bdc0>, body: {"keypair": {"name": "tempest-keypair-273150203", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqHKxtLd5YYnRChV81s/NtPPYEynTMzlPRPWPVwQBI2YDhess+OImkZYbjlr5QRm0GILxSNzmQQLK3h/m77phz1Kj26T0l8bsbgyhswnL1TzzRJ1k2iuW6x7T3Ysu08YQ=="}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:20:55.873645 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-78c9ffc7-9f55-412c-8e88-75a121e969e6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Getting quotas for project 92f354242a7b4ae4b774681eb633c2b2. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:20:55.877427 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-78c9ffc7-9f55-412c-8e88-75a121e969e6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Getting quotas for user ca9eb6b9dc6e409a954c7993ebe5a5c3 and project 92f354242a7b4ae4b774681eb633c2b2. Resources: {'key_pairs'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:20:55.898854 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-78c9ffc7-9f55-412c-8e88-75a121e969e6 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045577 Sep 09 13:20:55.899540 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 437/871] 10.222.0.17 () {62 vars in 1200 bytes} [Fri Sep 9 13:20:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 13:20:56.307242 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bb7064b9-9b04-438c-b0b5-0851114a4299 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:56.308053 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bb7064b9-9b04-438c-b0b5-0851114a4299 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:56.315408 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb7064b9-9b04-438c-b0b5-0851114a4299 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:56.315900 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb7064b9-9b04-438c-b0b5-0851114a4299 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:56.316338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb7064b9-9b04-438c-b0b5-0851114a4299 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:56.317029 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb7064b9-9b04-438c-b0b5-0851114a4299 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:56.317473 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb7064b9-9b04-438c-b0b5-0851114a4299 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:56.317894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bb7064b9-9b04-438c-b0b5-0851114a4299 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:56.344481 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bb7064b9-9b04-438c-b0b5-0851114a4299 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:20:56.424504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bb7064b9-9b04-438c-b0b5-0851114a4299 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 204 len: 0 microversion: 2.1 time: 0.121121 Sep 09 13:20:56.425511 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 435/872] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:20:56 2022] DELETE /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:20:56.436574 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5840a98b-0816-429c-8362-42bafa69074f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:56.437281 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5840a98b-0816-429c-8362-42bafa69074f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:56.444712 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5840a98b-0816-429c-8362-42bafa69074f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:56.445202 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5840a98b-0816-429c-8362-42bafa69074f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:56.445640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5840a98b-0816-429c-8362-42bafa69074f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:56.446483 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5840a98b-0816-429c-8362-42bafa69074f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:56.446944 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5840a98b-0816-429c-8362-42bafa69074f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:56.447399 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5840a98b-0816-429c-8362-42bafa69074f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:56.467857 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:56.491443 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-99d42833-30fa-47db-9a33-0dc39ea3306d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4feb2b43-3991-4da6-8801-0b2ee0c80624"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:20:56.494154 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-99d42833-30fa-47db-9a33-0dc39ea3306d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:56.501243 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99d42833-30fa-47db-9a33-0dc39ea3306d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:56.501724 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99d42833-30fa-47db-9a33-0dc39ea3306d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:56.502159 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99d42833-30fa-47db-9a33-0dc39ea3306d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:56.502850 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99d42833-30fa-47db-9a33-0dc39ea3306d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:56.503340 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99d42833-30fa-47db-9a33-0dc39ea3306d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:56.503758 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-99d42833-30fa-47db-9a33-0dc39ea3306d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:56.522631 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:20:56.679950 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5840a98b-0816-429c-8362-42bafa69074f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:56.687901 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5840a98b-0816-429c-8362-42bafa69074f tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1506 microversion: 2.1 time: 0.257324 Sep 09 13:20:56.688460 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 438/873] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:56 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:57.269528 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1814122436", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41494fb6-e618-4171-a520-7ea9252e7559"}], "security_groups": [{"name": "tempest-securitygroup--2077700515"}], "key_name": "tempest-keypair-273150203", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:20:57.377600 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] validate_networks() for [('41494fb6-e618-4171-a520-7ea9252e7559', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:20:57.598946 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-99d42833-30fa-47db-9a33-0dc39ea3306d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "POST /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.111553 Sep 09 13:20:57.600211 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 436/874] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 13:20:56 2022] POST /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/os-volume_attachments => generated 194 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:20:57.714185 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-852b396f-1786-448d-b704-7776e50d940d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:57.715099 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-852b396f-1786-448d-b704-7776e50d940d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:57.723542 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-852b396f-1786-448d-b704-7776e50d940d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:57.724042 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-852b396f-1786-448d-b704-7776e50d940d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:57.724483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-852b396f-1786-448d-b704-7776e50d940d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:57.725192 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-852b396f-1786-448d-b704-7776e50d940d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:57.725727 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-852b396f-1786-448d-b704-7776e50d940d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:57.726343 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-852b396f-1786-448d-b704-7776e50d940d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:57.871871 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-852b396f-1786-448d-b704-7776e50d940d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:57.880191 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-852b396f-1786-448d-b704-7776e50d940d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1506 microversion: 2.1 time: 0.172282 Sep 09 13:20:57.880779 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 437/875] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:57 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:20:58.175956 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:20:58.177018 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:20:58.177478 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:20:58.177887 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:20:58.178463 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:20:58.188389 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:58.188864 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:58.189489 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:58.190430 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:58.190886 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:58.191334 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:58.208789 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Getting quotas for project 92f354242a7b4ae4b774681eb633c2b2. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:20:58.212826 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Getting quotas for user ca9eb6b9dc6e409a954c7993ebe5a5c3 and project 92f354242a7b4ae4b774681eb633c2b2. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:20:58.224956 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:20:58.227321 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:20:58.275918 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d890e282-53d3-425a-8202-ddbabb0b9a82 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.011363 Sep 09 13:20:58.283097 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 439/876] 10.222.0.17 () {62 vars in 1188 bytes} [Fri Sep 9 13:20:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 09 13:20:58.288877 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ca4c8a75-838b-447c-a910-5a98f401c91f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:58.289491 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ca4c8a75-838b-447c-a910-5a98f401c91f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:58.347362 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ca4c8a75-838b-447c-a910-5a98f401c91f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:58.354963 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ca4c8a75-838b-447c-a910-5a98f401c91f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:58.356577 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ca4c8a75-838b-447c-a910-5a98f401c91f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:58.358523 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ca4c8a75-838b-447c-a910-5a98f401c91f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1281 microversion: 2.20 time: 0.073298 Sep 09 13:20:58.359105 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 438/877] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:20:58 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:20:58.477385 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-eef37e1b-2801-4c72-ba54-f4d4c2c709a3 req-f6058bb2-b769-44e2-a565-c4b09085e48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1258804f-2f19-4ed2-94c2-0d75ea5360e5", "name": "network-vif-deleted", "tag": "6111168d-48bc-4721-b702-cd5679acabff"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:20:58.653469 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-eef37e1b-2801-4c72-ba54-f4d4c2c709a3 req-f6058bb2-b769-44e2-a565-c4b09085e48e service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:58.653960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-eef37e1b-2801-4c72-ba54-f4d4c2c709a3 req-f6058bb2-b769-44e2-a565-c4b09085e48e service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:58.654449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-eef37e1b-2801-4c72-ba54-f4d4c2c709a3 req-f6058bb2-b769-44e2-a565-c4b09085e48e service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:58.665371 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-eef37e1b-2801-4c72-ba54-f4d4c2c709a3 req-f6058bb2-b769-44e2-a565-c4b09085e48e service nova] Creating event network-vif-deleted:6111168d-48bc-4721-b702-cd5679acabff for instance 1258804f-2f19-4ed2-94c2-0d75ea5360e5 on hv-cinder-83124 Sep 09 13:20:58.671317 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-eef37e1b-2801-4c72-ba54-f4d4c2c709a3 req-f6058bb2-b769-44e2-a565-c4b09085e48e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197673 Sep 09 13:20:58.671923 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 440/878] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:20:58.903185 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-aae6b953-3ede-4bab-9733-b9372ac0bbbb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:58.903798 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-aae6b953-3ede-4bab-9733-b9372ac0bbbb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:58.913314 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aae6b953-3ede-4bab-9733-b9372ac0bbbb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:58.913806 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aae6b953-3ede-4bab-9733-b9372ac0bbbb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:58.914327 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aae6b953-3ede-4bab-9733-b9372ac0bbbb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:58.914930 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aae6b953-3ede-4bab-9733-b9372ac0bbbb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:58.915523 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aae6b953-3ede-4bab-9733-b9372ac0bbbb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:58.915827 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aae6b953-3ede-4bab-9733-b9372ac0bbbb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:58.946894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aae6b953-3ede-4bab-9733-b9372ac0bbbb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:58.947350 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aae6b953-3ede-4bab-9733-b9372ac0bbbb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:58.947787 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aae6b953-3ede-4bab-9733-b9372ac0bbbb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:58.948229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-aae6b953-3ede-4bab-9733-b9372ac0bbbb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lazy-loading 'fault' on Instance uuid 1258804f-2f19-4ed2-94c2-0d75ea5360e5 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:20:58.988052 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-aae6b953-3ede-4bab-9733-b9372ac0bbbb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:58.995641 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-aae6b953-3ede-4bab-9733-b9372ac0bbbb tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 200 len: 1310 microversion: 2.1 time: 0.096468 Sep 09 13:20:58.996461 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 439/879] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:20:58 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:20:59.385256 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e010c066-e5b8-4b0c-9199-f1f126549370 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:20:59.386075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e010c066-e5b8-4b0c-9199-f1f126549370 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:20:59.392474 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e010c066-e5b8-4b0c-9199-f1f126549370 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:59.392960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e010c066-e5b8-4b0c-9199-f1f126549370 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:59.393394 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e010c066-e5b8-4b0c-9199-f1f126549370 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:59.394205 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e010c066-e5b8-4b0c-9199-f1f126549370 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:20:59.394663 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e010c066-e5b8-4b0c-9199-f1f126549370 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:20:59.395109 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e010c066-e5b8-4b0c-9199-f1f126549370 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:20:59.461961 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e010c066-e5b8-4b0c-9199-f1f126549370 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:59.469960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e010c066-e5b8-4b0c-9199-f1f126549370 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:59.471436 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e010c066-e5b8-4b0c-9199-f1f126549370 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:20:59.472522 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e010c066-e5b8-4b0c-9199-f1f126549370 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1333 microversion: 2.20 time: 0.091595 Sep 09 13:20:59.473052 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 441/880] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:20:59 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:21:00.019466 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ff108b55-0604-40fc-87bb-955259f8378c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:00.020096 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ff108b55-0604-40fc-87bb-955259f8378c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 1258804f-2f19-4ed2-94c2-0d75ea5360e5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:00.026529 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff108b55-0604-40fc-87bb-955259f8378c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:00.027010 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff108b55-0604-40fc-87bb-955259f8378c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:00.027504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff108b55-0604-40fc-87bb-955259f8378c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:00.028196 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff108b55-0604-40fc-87bb-955259f8378c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:00.028643 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff108b55-0604-40fc-87bb-955259f8378c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:00.029440 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ff108b55-0604-40fc-87bb-955259f8378c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:00.044121 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-ff108b55-0604-40fc-87bb-955259f8378c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] HTTP exception thrown: Instance 1258804f-2f19-4ed2-94c2-0d75ea5360e5 could not be found. Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ff108b55-0604-40fc-87bb-955259f8378c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Request method failure captured: Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 HTTP/1.1 Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxMaP5VQ9Fa4ImIgAfQPE2uyEKzPqrSzG7jDqHVKheNPr4YU7dLoJPAu1rRTBsxWJj2PugBC5JGZ6kf7tsaYSTWABRQuj-o4spLAESfpGmqV5VvqtmG6FoGDvekFdSvHcYXGJy8g3zxH-DAzraEBEuS_8Rx758zmWkj4bVIt3J4Dcs Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 1eedefa6b656409f902d158e77d94aa0 Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:21:00.046719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:21:00.048317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1eedefa6b656409f902d158e77d94aa0", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:00.048317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:21:00.048317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 1eedefa6b656409f902d158e77d94aa0 Sep 09 13:21:00.048317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:21:00.048317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-ServerRescueNegativeTestJSON-819143313-project Sep 09 13:21:00.048317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:21:00.048317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:21:00.048317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: 21700a3c2ff24fc6a3bb5db8bf283f5c Sep 09 13:21:00.048317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-ServerRescueNegativeTestJSON-819143313-project Sep 09 13:21:00.048317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:21:00.048317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance 1258804f-2f19-4ed2-94c2-0d75ea5360e5 could not be found. Sep 09 13:21:00.048317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '1258804f-2f19-4ed2-94c2-0d75ea5360e5'} Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1258804f-2f19-4ed2-94c2-0d75ea5360e5 could not be found. Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:00.049141 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1258804f-2f19-4ed2-94c2-0d75ea5360e5 could not be found. Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1258804f-2f19-4ed2-94c2-0d75ea5360e5 could not be found. Sep 09 13:21:00.050360 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:00.051472 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ff108b55-0604-40fc-87bb-955259f8378c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Returning 404 to user: Instance 1258804f-2f19-4ed2-94c2-0d75ea5360e5 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:00.051472 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ff108b55-0604-40fc-87bb-955259f8378c tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5" status: 404 len: 111 microversion: 2.1 time: 0.032624 Sep 09 13:21:00.051472 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 440/881] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:00 2022] GET /compute/v2.1/servers/1258804f-2f19-4ed2-94c2-0d75ea5360e5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:21:00.056743 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-abc3c174-5902-4f6d-9ed8-58653be1aa3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:00.057232 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-abc3c174-5902-4f6d-9ed8-58653be1aa3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:00.064401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abc3c174-5902-4f6d-9ed8-58653be1aa3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:00.064898 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abc3c174-5902-4f6d-9ed8-58653be1aa3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:00.065338 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abc3c174-5902-4f6d-9ed8-58653be1aa3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:00.066063 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abc3c174-5902-4f6d-9ed8-58653be1aa3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:00.066516 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abc3c174-5902-4f6d-9ed8-58653be1aa3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:00.066940 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-abc3c174-5902-4f6d-9ed8-58653be1aa3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:00.093759 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-abc3c174-5902-4f6d-9ed8-58653be1aa3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:21:00.170856 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-abc3c174-5902-4f6d-9ed8-58653be1aa3b tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 204 len: 0 microversion: 2.1 time: 0.116920 Sep 09 13:21:00.171830 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 442/882] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:21:00 2022] DELETE /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:21:00.180098 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-68e7e024-4d0b-4ac7-ba89-55e18db1197e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:00.180860 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-68e7e024-4d0b-4ac7-ba89-55e18db1197e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:00.188017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68e7e024-4d0b-4ac7-ba89-55e18db1197e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:00.188500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68e7e024-4d0b-4ac7-ba89-55e18db1197e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:00.188935 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68e7e024-4d0b-4ac7-ba89-55e18db1197e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:00.189631 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68e7e024-4d0b-4ac7-ba89-55e18db1197e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:00.190080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68e7e024-4d0b-4ac7-ba89-55e18db1197e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:00.190534 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68e7e024-4d0b-4ac7-ba89-55e18db1197e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:00.326780 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-68e7e024-4d0b-4ac7-ba89-55e18db1197e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:00.334573 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-68e7e024-4d0b-4ac7-ba89-55e18db1197e tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.158460 Sep 09 13:21:00.335153 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 441/883] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:00 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:21:00.501168 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db2e2fc0-78f2-4136-b8a8-b507cf19a6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:00.502663 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db2e2fc0-78f2-4136-b8a8-b507cf19a6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:00.509957 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db2e2fc0-78f2-4136-b8a8-b507cf19a6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:00.510608 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db2e2fc0-78f2-4136-b8a8-b507cf19a6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:00.511239 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db2e2fc0-78f2-4136-b8a8-b507cf19a6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:00.512696 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db2e2fc0-78f2-4136-b8a8-b507cf19a6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:00.513311 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db2e2fc0-78f2-4136-b8a8-b507cf19a6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:00.514652 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db2e2fc0-78f2-4136-b8a8-b507cf19a6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:00.657751 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-db2e2fc0-78f2-4136-b8a8-b507cf19a6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:00.665792 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-db2e2fc0-78f2-4136-b8a8-b507cf19a6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:00.667280 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-db2e2fc0-78f2-4136-b8a8-b507cf19a6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:00.668371 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db2e2fc0-78f2-4136-b8a8-b507cf19a6b8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1407 microversion: 2.20 time: 0.174300 Sep 09 13:21:00.668920 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 443/884] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:00 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:21:01.358530 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d97090f3-2cea-4875-9bbf-41430d86553a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:01.359168 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d97090f3-2cea-4875-9bbf-41430d86553a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:01.365704 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d97090f3-2cea-4875-9bbf-41430d86553a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:01.366192 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d97090f3-2cea-4875-9bbf-41430d86553a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:01.366631 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d97090f3-2cea-4875-9bbf-41430d86553a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:01.367359 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d97090f3-2cea-4875-9bbf-41430d86553a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:01.367820 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d97090f3-2cea-4875-9bbf-41430d86553a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:01.368248 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d97090f3-2cea-4875-9bbf-41430d86553a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:01.499875 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d97090f3-2cea-4875-9bbf-41430d86553a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:01.507474 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d97090f3-2cea-4875-9bbf-41430d86553a tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.153579 Sep 09 13:21:01.508035 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 442/885] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:01 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:01.694344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ccef1c64-6968-43c0-98a4-24a15b8efb95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:01.694949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ccef1c64-6968-43c0-98a4-24a15b8efb95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:01.701448 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccef1c64-6968-43c0-98a4-24a15b8efb95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:01.701922 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccef1c64-6968-43c0-98a4-24a15b8efb95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:01.702355 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccef1c64-6968-43c0-98a4-24a15b8efb95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:01.703040 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccef1c64-6968-43c0-98a4-24a15b8efb95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:01.703511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccef1c64-6968-43c0-98a4-24a15b8efb95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:01.703928 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ccef1c64-6968-43c0-98a4-24a15b8efb95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:01.834498 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ccef1c64-6968-43c0-98a4-24a15b8efb95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:01.843123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ccef1c64-6968-43c0-98a4-24a15b8efb95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:01.844565 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ccef1c64-6968-43c0-98a4-24a15b8efb95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:01.845658 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ccef1c64-6968-43c0-98a4-24a15b8efb95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1407 microversion: 2.20 time: 0.155326 Sep 09 13:21:01.846213 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 444/886] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:01 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:21:02.531633 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-932da17e-ad33-4a0e-b9d4-c0f6f7e1e500 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:02.532486 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-932da17e-ad33-4a0e-b9d4-c0f6f7e1e500 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:02.540155 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-932da17e-ad33-4a0e-b9d4-c0f6f7e1e500 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:02.540648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-932da17e-ad33-4a0e-b9d4-c0f6f7e1e500 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:02.541087 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-932da17e-ad33-4a0e-b9d4-c0f6f7e1e500 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:02.541847 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-932da17e-ad33-4a0e-b9d4-c0f6f7e1e500 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:02.542303 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-932da17e-ad33-4a0e-b9d4-c0f6f7e1e500 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:02.542726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-932da17e-ad33-4a0e-b9d4-c0f6f7e1e500 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:02.681715 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-932da17e-ad33-4a0e-b9d4-c0f6f7e1e500 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:02.690603 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-932da17e-ad33-4a0e-b9d4-c0f6f7e1e500 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1521 microversion: 2.1 time: 0.163329 Sep 09 13:21:02.691192 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 443/887] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:02 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:02.871504 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71ee612f-9927-4d35-a744-7f065c22476d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:02.872230 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-71ee612f-9927-4d35-a744-7f065c22476d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:02.879325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71ee612f-9927-4d35-a744-7f065c22476d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:02.879815 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71ee612f-9927-4d35-a744-7f065c22476d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:02.880256 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71ee612f-9927-4d35-a744-7f065c22476d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:02.880953 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71ee612f-9927-4d35-a744-7f065c22476d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:02.881410 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71ee612f-9927-4d35-a744-7f065c22476d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:02.881836 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71ee612f-9927-4d35-a744-7f065c22476d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:03.151067 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-71ee612f-9927-4d35-a744-7f065c22476d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:03.159675 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-71ee612f-9927-4d35-a744-7f065c22476d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:03.161118 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-71ee612f-9927-4d35-a744-7f065c22476d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:03.162257 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71ee612f-9927-4d35-a744-7f065c22476d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1407 microversion: 2.20 time: 0.294993 Sep 09 13:21:03.162962 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 445/888] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:02 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:21:03.206600 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-174e4f72-a4e1-4193-82b2-11bcbbc37e92 req-7a227c99-21f9-40aa-b618-bf3c55e19b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2bed376-e738-4913-8eea-71014b54ed1f", "tag": "38c754fd-a2fb-4031-a376-b82c80b97094"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:03.217433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-174e4f72-a4e1-4193-82b2-11bcbbc37e92 req-7a227c99-21f9-40aa-b618-bf3c55e19b84 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:03.217915 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-174e4f72-a4e1-4193-82b2-11bcbbc37e92 req-7a227c99-21f9-40aa-b618-bf3c55e19b84 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:03.218355 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-174e4f72-a4e1-4193-82b2-11bcbbc37e92 req-7a227c99-21f9-40aa-b618-bf3c55e19b84 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:03.237540 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-174e4f72-a4e1-4193-82b2-11bcbbc37e92 req-7a227c99-21f9-40aa-b618-bf3c55e19b84 service nova] Creating event network-changed:38c754fd-a2fb-4031-a376-b82c80b97094 for instance b2bed376-e738-4913-8eea-71014b54ed1f on hv-cinder-83124 Sep 09 13:21:03.242160 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-174e4f72-a4e1-4193-82b2-11bcbbc37e92 req-7a227c99-21f9-40aa-b618-bf3c55e19b84 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040258 Sep 09 13:21:03.242777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 444/889] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:21:03.715568 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a00e3c5e-9588-45cd-aa6d-72f7be43b30d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:03.716262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a00e3c5e-9588-45cd-aa6d-72f7be43b30d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:03.723928 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a00e3c5e-9588-45cd-aa6d-72f7be43b30d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:03.726186 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a00e3c5e-9588-45cd-aa6d-72f7be43b30d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:03.726963 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a00e3c5e-9588-45cd-aa6d-72f7be43b30d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:03.728395 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a00e3c5e-9588-45cd-aa6d-72f7be43b30d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:03.738376 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a00e3c5e-9588-45cd-aa6d-72f7be43b30d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:03.738839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a00e3c5e-9588-45cd-aa6d-72f7be43b30d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:03.820784 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a00e3c5e-9588-45cd-aa6d-72f7be43b30d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:03.829079 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a00e3c5e-9588-45cd-aa6d-72f7be43b30d tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1307 microversion: 2.1 time: 0.118041 Sep 09 13:21:03.829635 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 446/890] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:03 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1307 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:04.189706 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-92806090-3529-40ac-b36e-fdc0cfda61c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:04.190545 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-92806090-3529-40ac-b36e-fdc0cfda61c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:04.197029 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92806090-3529-40ac-b36e-fdc0cfda61c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:04.197599 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92806090-3529-40ac-b36e-fdc0cfda61c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:04.198079 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92806090-3529-40ac-b36e-fdc0cfda61c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:04.198989 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92806090-3529-40ac-b36e-fdc0cfda61c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:04.199508 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92806090-3529-40ac-b36e-fdc0cfda61c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:04.200009 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92806090-3529-40ac-b36e-fdc0cfda61c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:04.366718 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-92806090-3529-40ac-b36e-fdc0cfda61c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:04.377409 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-92806090-3529-40ac-b36e-fdc0cfda61c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:04.378936 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-92806090-3529-40ac-b36e-fdc0cfda61c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:04.380217 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-92806090-3529-40ac-b36e-fdc0cfda61c9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1407 microversion: 2.20 time: 0.195835 Sep 09 13:21:04.380926 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 445/891] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:04 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:21:04.852017 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-67eefea2-0105-4db8-9485-d47be8e27728 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:04.852629 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-67eefea2-0105-4db8-9485-d47be8e27728 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:04.859768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67eefea2-0105-4db8-9485-d47be8e27728 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:04.860252 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67eefea2-0105-4db8-9485-d47be8e27728 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:04.860689 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67eefea2-0105-4db8-9485-d47be8e27728 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:04.861381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67eefea2-0105-4db8-9485-d47be8e27728 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:04.861839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67eefea2-0105-4db8-9485-d47be8e27728 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:04.862314 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67eefea2-0105-4db8-9485-d47be8e27728 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:04.889182 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:04.893501 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67eefea2-0105-4db8-9485-d47be8e27728 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:04.893977 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67eefea2-0105-4db8-9485-d47be8e27728 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:04.894410 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-67eefea2-0105-4db8-9485-d47be8e27728 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:04.894853 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-67eefea2-0105-4db8-9485-d47be8e27728 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lazy-loading 'fault' on Instance uuid 6b9110cf-907a-46bc-8e9d-31dd3c409e39 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:21:04.939382 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-67eefea2-0105-4db8-9485-d47be8e27728 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21700a3c2ff24fc6a3bb5db8bf283f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eedefa6b656409f902d158e77d94aa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:04.946916 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-67eefea2-0105-4db8-9485-d47be8e27728 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 200 len: 1312 microversion: 2.1 time: 0.098746 Sep 09 13:21:04.947503 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 447/892] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:04 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:05.156663 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-90196d12-d832-4bfb-9caa-21e76199531e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4feb2b43-3991-4da6-8801-0b2ee0c80624"}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:05.159122 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-90196d12-d832-4bfb-9caa-21e76199531e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:05.165069 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90196d12-d832-4bfb-9caa-21e76199531e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:05.165547 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90196d12-d832-4bfb-9caa-21e76199531e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:05.165978 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90196d12-d832-4bfb-9caa-21e76199531e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:05.166655 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90196d12-d832-4bfb-9caa-21e76199531e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:05.167127 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90196d12-d832-4bfb-9caa-21e76199531e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:05.167549 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-90196d12-d832-4bfb-9caa-21e76199531e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:05.246642 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-90196d12-d832-4bfb-9caa-21e76199531e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] HTTP exception thrown: Invalid volume: volume 4feb2b43-3991-4da6-8801-0b2ee0c80624 is already attached to instances: 68162eb9-cbe5-401b-bd53-8a1a715bb164 Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-90196d12-d832-4bfb-9caa-21e76199531e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Request method failure captured: Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: POST /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/os-volume_attachments HTTP/1.1 Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 74 Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxOEkSw_D0B2DWW3aDp6JHSyeYSFkFADbNPgrw4so5mlP-Ugc06W6Rkqydb-b3AAsVzR7p1RzJdXA1668TSyot_sK8AkXdZkK5Jg9C97nHfO5kDuLQSdUnou_VoOzEQjYwBo46vUgiPeKNiJ0QlKMZ9JN2CFXzSZOPwjJ0bmZDR7mw Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:21:05.248638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:21:05.250251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6b24b42ca93941aa8e70f5fa10303f4d", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:05.250251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:21:05.250251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:21:05.250251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:21:05.250251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:21:05.250251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:21:05.250251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:21:05.250251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: dcb88983a8e1439588644b71170d7362 Sep 09 13:21:05.250251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:21:05.250251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Sep 09 13:21:05.250251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {"volumeAttachment": {"volumeId": "4feb2b43-3991-4da6-8801-0b2ee0c80624"}} Sep 09 13:21:05.250251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Invalid volume: volume 4feb2b43-3991-4da6-8801-0b2ee0c80624 is already attached to instances: 68162eb9-cbe5-401b-bd53-8a1a715bb164 Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'server_id': '68162eb9-cbe5-401b-bd53-8a1a715bb164', 'body': {'volumeAttachment': {'volumeId': '4feb2b43-3991-4da6-8801-0b2ee0c80624'}}} Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4feb2b43-3991-4da6-8801-0b2ee0c80624 is already attached to instances: 68162eb9-cbe5-401b-bd53-8a1a715bb164 Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:05.251173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4feb2b43-3991-4da6-8801-0b2ee0c80624 is already attached to instances: 68162eb9-cbe5-401b-bd53-8a1a715bb164 Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:05.252591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:05.254131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:05.254131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:05.254131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:05.254131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4feb2b43-3991-4da6-8801-0b2ee0c80624 is already attached to instances: 68162eb9-cbe5-401b-bd53-8a1a715bb164 Sep 09 13:21:05.254131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:05.254131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-90196d12-d832-4bfb-9caa-21e76199531e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Returning 400 to user: Invalid volume: volume 4feb2b43-3991-4da6-8801-0b2ee0c80624 is already attached to instances: 68162eb9-cbe5-401b-bd53-8a1a715bb164 {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:05.254131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-90196d12-d832-4bfb-9caa-21e76199531e tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "POST /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098189 Sep 09 13:21:05.254131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 446/893] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 13:21:05 2022] POST /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:21:05.263800 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-824b871b-d517-4b88-8eab-df1782cf1894 req-469f6e17-32db-49a1-a4d1-9199839e5742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9110cf-907a-46bc-8e9d-31dd3c409e39", "name": "network-vif-deleted", "tag": "bcff1243-0152-492c-9c36-aa3e840243d3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:05.272973 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-824b871b-d517-4b88-8eab-df1782cf1894 req-469f6e17-32db-49a1-a4d1-9199839e5742 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:05.273450 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-824b871b-d517-4b88-8eab-df1782cf1894 req-469f6e17-32db-49a1-a4d1-9199839e5742 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:05.273875 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-824b871b-d517-4b88-8eab-df1782cf1894 req-469f6e17-32db-49a1-a4d1-9199839e5742 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:05.284914 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-824b871b-d517-4b88-8eab-df1782cf1894 req-469f6e17-32db-49a1-a4d1-9199839e5742 service nova] Creating event network-vif-deleted:bcff1243-0152-492c-9c36-aa3e840243d3 for instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 on hv-cinder-83124 Sep 09 13:21:05.289641 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-824b871b-d517-4b88-8eab-df1782cf1894 req-469f6e17-32db-49a1-a4d1-9199839e5742 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029908 Sep 09 13:21:05.290156 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 448/894] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:05.319693 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-82157669-8b69-4828-8c40-70782a8945e1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:05.320233 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-82157669-8b69-4828-8c40-70782a8945e1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:05.326746 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-82157669-8b69-4828-8c40-70782a8945e1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:05.327420 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-82157669-8b69-4828-8c40-70782a8945e1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:05.327857 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-82157669-8b69-4828-8c40-70782a8945e1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:05.328537 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-82157669-8b69-4828-8c40-70782a8945e1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:05.328985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-82157669-8b69-4828-8c40-70782a8945e1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:05.329404 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-82157669-8b69-4828-8c40-70782a8945e1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:05.406472 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f7fd1f42-ead2-446f-9a35-5ff7c8aaa0c1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:05.407384 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f7fd1f42-ead2-446f-9a35-5ff7c8aaa0c1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:05.414425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7fd1f42-ead2-446f-9a35-5ff7c8aaa0c1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:05.415140 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7fd1f42-ead2-446f-9a35-5ff7c8aaa0c1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:05.415728 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7fd1f42-ead2-446f-9a35-5ff7c8aaa0c1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:05.416583 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7fd1f42-ead2-446f-9a35-5ff7c8aaa0c1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:05.417418 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7fd1f42-ead2-446f-9a35-5ff7c8aaa0c1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:05.422873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f7fd1f42-ead2-446f-9a35-5ff7c8aaa0c1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:05.426825 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-82157669-8b69-4828-8c40-70782a8945e1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lazy-loading 'services' on Instance uuid 68162eb9-cbe5-401b-bd53-8a1a715bb164 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:21:05.506812 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-82157669-8b69-4828-8c40-70782a8945e1 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/os-volume_attachments/4feb2b43-3991-4da6-8801-0b2ee0c80624" status: 202 len: 0 microversion: 2.1 time: 0.190815 Sep 09 13:21:05.507576 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 447/895] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 13:21:05 2022] DELETE /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/os-volume_attachments/4feb2b43-3991-4da6-8801-0b2ee0c80624 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:21:05.517313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a4764b33-22de-49f3-a252-b58fcd563e7f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:05.519952 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a4764b33-22de-49f3-a252-b58fcd563e7f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:05.526709 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4764b33-22de-49f3-a252-b58fcd563e7f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:05.527521 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4764b33-22de-49f3-a252-b58fcd563e7f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:05.528165 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4764b33-22de-49f3-a252-b58fcd563e7f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:05.529524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4764b33-22de-49f3-a252-b58fcd563e7f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:05.530340 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4764b33-22de-49f3-a252-b58fcd563e7f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:05.531113 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a4764b33-22de-49f3-a252-b58fcd563e7f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:05.567281 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a4764b33-22de-49f3-a252-b58fcd563e7f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054894 Sep 09 13:21:05.568004 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 448/896] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:21:05 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:05.636843 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f7fd1f42-ead2-446f-9a35-5ff7c8aaa0c1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:05.645512 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f7fd1f42-ead2-446f-9a35-5ff7c8aaa0c1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:05.646945 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-f7fd1f42-ead2-446f-9a35-5ff7c8aaa0c1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:05.648099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f7fd1f42-ead2-446f-9a35-5ff7c8aaa0c1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1407 microversion: 2.20 time: 0.247463 Sep 09 13:21:05.648885 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 449/897] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:05 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:21:05.969780 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8d985937-bf95-455e-ae2c-492b09ac2fa1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:05.970581 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8d985937-bf95-455e-ae2c-492b09ac2fa1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] [instance: 6b9110cf-907a-46bc-8e9d-31dd3c409e39] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:05.977072 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d985937-bf95-455e-ae2c-492b09ac2fa1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:05.985386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d985937-bf95-455e-ae2c-492b09ac2fa1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:05.989181 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d985937-bf95-455e-ae2c-492b09ac2fa1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:05.990632 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d985937-bf95-455e-ae2c-492b09ac2fa1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:05.991214 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d985937-bf95-455e-ae2c-492b09ac2fa1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:05.991961 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8d985937-bf95-455e-ae2c-492b09ac2fa1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:06.012651 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-8d985937-bf95-455e-ae2c-492b09ac2fa1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] HTTP exception thrown: Instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 could not be found. Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8d985937-bf95-455e-ae2c-492b09ac2fa1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Request method failure captured: Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 HTTP/1.1 Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxMaP5VQ9Fa4ImIgAfQPE2uyEKzPqrSzG7jDqHVKheNPr4YU7dLoJPAu1rRTBsxWJj2PugBC5JGZ6kf7tsaYSTWABRQuj-o4spLAESfpGmqV5VvqtmG6FoGDvekFdSvHcYXGJy8g3zxH-DAzraEBEuS_8Rx758zmWkj4bVIt3J4Dcs Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 1eedefa6b656409f902d158e77d94aa0 Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:21:06.014436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:21:06.016108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1eedefa6b656409f902d158e77d94aa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1eedefa6b656409f902d158e77d94aa0", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:06.016108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:21:06.016108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 1eedefa6b656409f902d158e77d94aa0 Sep 09 13:21:06.016108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-819143313 Sep 09 13:21:06.016108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-ServerRescueNegativeTestJSON-819143313-project Sep 09 13:21:06.016108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:21:06.016108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:21:06.016108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: 21700a3c2ff24fc6a3bb5db8bf283f5c Sep 09 13:21:06.016108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-ServerRescueNegativeTestJSON-819143313-project Sep 09 13:21:06.016108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:21:06.016108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 could not be found. Sep 09 13:21:06.016108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '6b9110cf-907a-46bc-8e9d-31dd3c409e39'} Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 could not be found. Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:06.017027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 could not be found. Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 could not be found. Sep 09 13:21:06.018564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:06.020907 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8d985937-bf95-455e-ae2c-492b09ac2fa1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] Returning 404 to user: Instance 6b9110cf-907a-46bc-8e9d-31dd3c409e39 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:06.020907 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8d985937-bf95-455e-ae2c-492b09ac2fa1 tempest-ServerRescueNegativeTestJSON-819143313 tempest-ServerRescueNegativeTestJSON-819143313-project] 10.222.0.17 "GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39" status: 404 len: 111 microversion: 2.1 time: 0.050139 Sep 09 13:21:06.020907 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 449/898] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:05 2022] GET /compute/v2.1/servers/6b9110cf-907a-46bc-8e9d-31dd3c409e39 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:21:06.580219 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d0469268-9c03-4aa2-87f6-e43f6fd6906b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:06.582370 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d0469268-9c03-4aa2-87f6-e43f6fd6906b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:06.588829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0469268-9c03-4aa2-87f6-e43f6fd6906b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:06.589318 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0469268-9c03-4aa2-87f6-e43f6fd6906b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:06.589755 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0469268-9c03-4aa2-87f6-e43f6fd6906b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:06.590452 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0469268-9c03-4aa2-87f6-e43f6fd6906b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:06.590913 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0469268-9c03-4aa2-87f6-e43f6fd6906b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:06.591367 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d0469268-9c03-4aa2-87f6-e43f6fd6906b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:06.622306 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d0469268-9c03-4aa2-87f6-e43f6fd6906b tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046330 Sep 09 13:21:06.622934 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 450/899] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:21:06 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:21:06.673490 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2b75e1e4-d5c6-4476-a952-dd64abaaacd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:06.674110 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2b75e1e4-d5c6-4476-a952-dd64abaaacd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:06.680409 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2b75e1e4-d5c6-4476-a952-dd64abaaacd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:06.681173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2b75e1e4-d5c6-4476-a952-dd64abaaacd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:06.681612 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2b75e1e4-d5c6-4476-a952-dd64abaaacd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:06.682847 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2b75e1e4-d5c6-4476-a952-dd64abaaacd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:06.682847 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2b75e1e4-d5c6-4476-a952-dd64abaaacd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:06.683207 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2b75e1e4-d5c6-4476-a952-dd64abaaacd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:06.686724 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-db16499f-8382-45f6-9918-5002956d23a4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:06.687256 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db16499f-8382-45f6-9918-5002956d23a4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:06.693612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db16499f-8382-45f6-9918-5002956d23a4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:06.694325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db16499f-8382-45f6-9918-5002956d23a4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:06.694862 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db16499f-8382-45f6-9918-5002956d23a4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:06.695733 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db16499f-8382-45f6-9918-5002956d23a4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:06.696267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db16499f-8382-45f6-9918-5002956d23a4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:06.696792 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-db16499f-8382-45f6-9918-5002956d23a4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:06.723384 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-db16499f-8382-45f6-9918-5002956d23a4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:21:06.801031 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-db16499f-8382-45f6-9918-5002956d23a4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 204 len: 0 microversion: 2.1 time: 0.118617 Sep 09 13:21:06.801842 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 451/900] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:21:06 2022] DELETE /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:21:06.812265 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-242e40e6-1adc-4d61-8f45-b1ef8184383d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:06.812999 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-242e40e6-1adc-4d61-8f45-b1ef8184383d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:06.818986 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-242e40e6-1adc-4d61-8f45-b1ef8184383d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:06.819520 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-242e40e6-1adc-4d61-8f45-b1ef8184383d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:06.819966 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-242e40e6-1adc-4d61-8f45-b1ef8184383d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:06.820655 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-242e40e6-1adc-4d61-8f45-b1ef8184383d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:06.821108 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-242e40e6-1adc-4d61-8f45-b1ef8184383d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:06.821538 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-242e40e6-1adc-4d61-8f45-b1ef8184383d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:06.953938 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-242e40e6-1adc-4d61-8f45-b1ef8184383d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:06.957980 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2b75e1e4-d5c6-4476-a952-dd64abaaacd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:06.962059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-242e40e6-1adc-4d61-8f45-b1ef8184383d tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1681 microversion: 2.1 time: 0.153986 Sep 09 13:21:06.962629 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 452/901] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:06 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:06.966583 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2b75e1e4-d5c6-4476-a952-dd64abaaacd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:06.968373 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2b75e1e4-d5c6-4476-a952-dd64abaaacd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:06.969554 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2b75e1e4-d5c6-4476-a952-dd64abaaacd9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1407 microversion: 2.20 time: 0.300060 Sep 09 13:21:06.970254 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 450/902] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:06 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:21:07.986198 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f35bf4d-7f38-4e53-87d2-a3a103a12064 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:07.986754 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5f35bf4d-7f38-4e53-87d2-a3a103a12064 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:07.993851 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-91561b7b-2b8c-4c5c-8731-d48edb62e25b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:07.994442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f35bf4d-7f38-4e53-87d2-a3a103a12064 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:07.994600 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f35bf4d-7f38-4e53-87d2-a3a103a12064 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:07.995263 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-91561b7b-2b8c-4c5c-8731-d48edb62e25b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:07.995416 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f35bf4d-7f38-4e53-87d2-a3a103a12064 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:07.996528 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f35bf4d-7f38-4e53-87d2-a3a103a12064 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:07.997144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f35bf4d-7f38-4e53-87d2-a3a103a12064 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:07.997980 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5f35bf4d-7f38-4e53-87d2-a3a103a12064 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:08.002402 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-91561b7b-2b8c-4c5c-8731-d48edb62e25b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:08.002907 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-91561b7b-2b8c-4c5c-8731-d48edb62e25b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:08.003364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-91561b7b-2b8c-4c5c-8731-d48edb62e25b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:08.004276 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-91561b7b-2b8c-4c5c-8731-d48edb62e25b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:08.004894 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-91561b7b-2b8c-4c5c-8731-d48edb62e25b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:08.005471 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-91561b7b-2b8c-4c5c-8731-d48edb62e25b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:08.024731 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:08.156869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5f35bf4d-7f38-4e53-87d2-a3a103a12064 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:08.165119 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f35bf4d-7f38-4e53-87d2-a3a103a12064 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1681 microversion: 2.1 time: 0.183394 Sep 09 13:21:08.166013 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 453/903] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:07 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:08.330795 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-91561b7b-2b8c-4c5c-8731-d48edb62e25b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:08.343437 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-91561b7b-2b8c-4c5c-8731-d48edb62e25b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:08.345574 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-91561b7b-2b8c-4c5c-8731-d48edb62e25b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:08.347030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-91561b7b-2b8c-4c5c-8731-d48edb62e25b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1407 microversion: 2.20 time: 0.357003 Sep 09 13:21:08.347779 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 451/904] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:07 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1407 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:21:09.189544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ab1f8f5-3267-47f8-a403-dfd198c414e0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:09.190172 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5ab1f8f5-3267-47f8-a403-dfd198c414e0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:09.192362 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:09.193174 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=10 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:09.200219 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ab1f8f5-3267-47f8-a403-dfd198c414e0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:09.201593 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ab1f8f5-3267-47f8-a403-dfd198c414e0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:09.202061 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ab1f8f5-3267-47f8-a403-dfd198c414e0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:09.202773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ab1f8f5-3267-47f8-a403-dfd198c414e0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:09.203255 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ab1f8f5-3267-47f8-a403-dfd198c414e0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:09.203682 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ab1f8f5-3267-47f8-a403-dfd198c414e0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:09.331370 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ab1f8f5-3267-47f8-a403-dfd198c414e0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:09.339242 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ab1f8f5-3267-47f8-a403-dfd198c414e0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1614 microversion: 2.1 time: 0.153959 Sep 09 13:21:09.339817 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 454/905] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:09 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1614 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:09.373624 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1de8bd02-2114-4457-a2e8-be75b5055810 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:09.374391 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1de8bd02-2114-4457-a2e8-be75b5055810 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:09.376542 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:09.383256 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1de8bd02-2114-4457-a2e8-be75b5055810 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:09.383760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1de8bd02-2114-4457-a2e8-be75b5055810 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:09.384355 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1de8bd02-2114-4457-a2e8-be75b5055810 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:09.385066 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1de8bd02-2114-4457-a2e8-be75b5055810 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:09.385523 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1de8bd02-2114-4457-a2e8-be75b5055810 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:09.385948 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1de8bd02-2114-4457-a2e8-be75b5055810 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:09.548666 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1de8bd02-2114-4457-a2e8-be75b5055810 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:09.578036 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1de8bd02-2114-4457-a2e8-be75b5055810 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:09.580210 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1de8bd02-2114-4457-a2e8-be75b5055810 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:09.581592 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1de8bd02-2114-4457-a2e8-be75b5055810 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1407 microversion: 2.20 time: 0.212864 Sep 09 13:21:09.591635 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 452/906] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:09 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:21:09.912831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-02f44474-bb34-40e1-8e0c-dcddec43e9b1 req-d699a986-07e0-4993-a2df-3e86b7c63489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bed376-e738-4913-8eea-71014b54ed1f", "name": "network-vif-plugged", "status": "completed", "tag": "38c754fd-a2fb-4031-a376-b82c80b97094"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:09.927916 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-02f44474-bb34-40e1-8e0c-dcddec43e9b1 req-d699a986-07e0-4993-a2df-3e86b7c63489 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:09.928832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-02f44474-bb34-40e1-8e0c-dcddec43e9b1 req-d699a986-07e0-4993-a2df-3e86b7c63489 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:09.929584 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-02f44474-bb34-40e1-8e0c-dcddec43e9b1 req-d699a986-07e0-4993-a2df-3e86b7c63489 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:09.954342 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-02f44474-bb34-40e1-8e0c-dcddec43e9b1 req-d699a986-07e0-4993-a2df-3e86b7c63489 service nova] Creating event network-vif-plugged:38c754fd-a2fb-4031-a376-b82c80b97094 for instance b2bed376-e738-4913-8eea-71014b54ed1f on hv-cinder-83124 Sep 09 13:21:09.975081 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-02f44474-bb34-40e1-8e0c-dcddec43e9b1 req-d699a986-07e0-4993-a2df-3e86b7c63489 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247460 Sep 09 13:21:09.976625 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 455/907] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:09.989848 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-fd58f0c8-9df2-48e6-9343-8a40ef3614f4 req-35bbd114-00e2-4630-9b7e-9112ff95d24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68162eb9-cbe5-401b-bd53-8a1a715bb164", "name": "network-vif-deleted", "tag": "0fdd18ec-bd72-455b-b76a-776cd528e722"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:10.004832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-fd58f0c8-9df2-48e6-9343-8a40ef3614f4 req-35bbd114-00e2-4630-9b7e-9112ff95d24c service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:10.005333 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-fd58f0c8-9df2-48e6-9343-8a40ef3614f4 req-35bbd114-00e2-4630-9b7e-9112ff95d24c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:10.011568 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-fd58f0c8-9df2-48e6-9343-8a40ef3614f4 req-35bbd114-00e2-4630-9b7e-9112ff95d24c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:10.035828 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-fd58f0c8-9df2-48e6-9343-8a40ef3614f4 req-35bbd114-00e2-4630-9b7e-9112ff95d24c service nova] Creating event network-vif-deleted:0fdd18ec-bd72-455b-b76a-776cd528e722 for instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 on hv-cinder-83124 Sep 09 13:21:10.058920 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-fd58f0c8-9df2-48e6-9343-8a40ef3614f4 req-35bbd114-00e2-4630-9b7e-9112ff95d24c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072534 Sep 09 13:21:10.070448 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 453/908] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:10.368401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cc684a4c-dab7-4a5d-9046-a2805f79b798 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:10.369615 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cc684a4c-dab7-4a5d-9046-a2805f79b798 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:10.379092 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc684a4c-dab7-4a5d-9046-a2805f79b798 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:10.379753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc684a4c-dab7-4a5d-9046-a2805f79b798 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:10.380522 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc684a4c-dab7-4a5d-9046-a2805f79b798 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:10.381386 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc684a4c-dab7-4a5d-9046-a2805f79b798 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:10.382092 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc684a4c-dab7-4a5d-9046-a2805f79b798 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:10.382675 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc684a4c-dab7-4a5d-9046-a2805f79b798 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:10.420636 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc684a4c-dab7-4a5d-9046-a2805f79b798 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:10.421122 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc684a4c-dab7-4a5d-9046-a2805f79b798 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:10.422509 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cc684a4c-dab7-4a5d-9046-a2805f79b798 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:10.423149 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-cc684a4c-dab7-4a5d-9046-a2805f79b798 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lazy-loading 'fault' on Instance uuid 68162eb9-cbe5-401b-bd53-8a1a715bb164 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:21:10.473622 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cc684a4c-dab7-4a5d-9046-a2805f79b798 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:10.483620 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cc684a4c-dab7-4a5d-9046-a2805f79b798 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 200 len: 1331 microversion: 2.1 time: 0.122047 Sep 09 13:21:10.484503 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 456/909] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:10 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 1331 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:10.609432 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-97eaa0af-cb51-4e3c-be49-76f5f688ad7e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:10.610829 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-97eaa0af-cb51-4e3c-be49-76f5f688ad7e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:10.618755 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-97eaa0af-cb51-4e3c-be49-76f5f688ad7e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:10.619279 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-97eaa0af-cb51-4e3c-be49-76f5f688ad7e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:10.619707 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-97eaa0af-cb51-4e3c-be49-76f5f688ad7e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:10.620599 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-97eaa0af-cb51-4e3c-be49-76f5f688ad7e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:10.621048 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-97eaa0af-cb51-4e3c-be49-76f5f688ad7e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:10.621737 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-97eaa0af-cb51-4e3c-be49-76f5f688ad7e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:10.644098 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:10.772062 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-97eaa0af-cb51-4e3c-be49-76f5f688ad7e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:10.781686 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-97eaa0af-cb51-4e3c-be49-76f5f688ad7e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:10.783460 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-97eaa0af-cb51-4e3c-be49-76f5f688ad7e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:10.785074 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-97eaa0af-cb51-4e3c-be49-76f5f688ad7e tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1407 microversion: 2.20 time: 0.180224 Sep 09 13:21:10.800591 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 454/910] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:10 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:21:11.051531 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4b08d1c8-e069-4dd0-95b5-a76e35005395 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:11.052023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4b08d1c8-e069-4dd0-95b5-a76e35005395 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:11.058206 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b08d1c8-e069-4dd0-95b5-a76e35005395 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:11.058695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b08d1c8-e069-4dd0-95b5-a76e35005395 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:11.059149 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b08d1c8-e069-4dd0-95b5-a76e35005395 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:11.059902 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b08d1c8-e069-4dd0-95b5-a76e35005395 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:11.060945 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b08d1c8-e069-4dd0-95b5-a76e35005395 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:11.061370 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4b08d1c8-e069-4dd0-95b5-a76e35005395 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:11.086705 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4b08d1c8-e069-4dd0-95b5-a76e35005395 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/ips" status: 200 len: 144 microversion: 2.1 time: 0.039382 Sep 09 13:21:11.094004 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 457/911] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 13:21:11 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/ips => generated 144 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:11.507438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-47584c95-5268-44d7-94d4-25e15e615a45 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:11.508051 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-47584c95-5268-44d7-94d4-25e15e615a45 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:11.517520 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47584c95-5268-44d7-94d4-25e15e615a45 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:11.518032 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47584c95-5268-44d7-94d4-25e15e615a45 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:11.518514 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47584c95-5268-44d7-94d4-25e15e615a45 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:11.519163 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47584c95-5268-44d7-94d4-25e15e615a45 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:11.519614 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47584c95-5268-44d7-94d4-25e15e615a45 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:11.520033 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-47584c95-5268-44d7-94d4-25e15e615a45 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:11.540296 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-47584c95-5268-44d7-94d4-25e15e615a45 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] HTTP exception thrown: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-47584c95-5268-44d7-94d4-25e15e615a45 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Request method failure captured: Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 HTTP/1.1 Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxOEkSw_D0B2DWW3aDp6JHSyeYSFkFADbNPgrw4so5mlP-Ugc06W6Rkqydb-b3AAsVzR7p1RzJdXA1668TSyot_sK8AkXdZkK5Jg9C97nHfO5kDuLQSdUnou_VoOzEQjYwBo46vUgiPeKNiJ0QlKMZ9JN2CFXzSZOPwjJ0bmZDR7mw Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:21:11.541943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:21:11.543762 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6b24b42ca93941aa8e70f5fa10303f4d", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:11.543762 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:21:11.543762 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:21:11.543762 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:21:11.543762 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:21:11.543762 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:21:11.543762 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:21:11.543762 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: dcb88983a8e1439588644b71170d7362 Sep 09 13:21:11.543762 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:21:11.543762 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:21:11.543762 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:21:11.543762 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '68162eb9-cbe5-401b-bd53-8a1a715bb164'} Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:11.545157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:21:11.548524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:11.550385 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-47584c95-5268-44d7-94d4-25e15e615a45 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Returning 404 to user: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:11.550385 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-47584c95-5268-44d7-94d4-25e15e615a45 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 404 len: 111 microversion: 2.1 time: 0.039870 Sep 09 13:21:11.553571 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8a5198aa-779a-43e8-9c24-2f0d2f1e2e23 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '.version_select at 0x7fd4a17fbb80>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:11.558464 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 455/912] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:11 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:21:11.573306 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8a5198aa-779a-43e8-9c24-2f0d2f1e2e23 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754036516" status: 202 len: 0 microversion: 2.1 time: 0.023832 Sep 09 13:21:11.574177 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 458/913] 10.222.0.17 () {58 vars in 1221 bytes} [Fri Sep 9 13:21:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754036516 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:21:11.818501 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e69dd59a-a291-4bf1-8d81-2d6e8ec959ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:11.819719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e69dd59a-a291-4bf1-8d81-2d6e8ec959ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:11.830509 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e69dd59a-a291-4bf1-8d81-2d6e8ec959ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:11.831779 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e69dd59a-a291-4bf1-8d81-2d6e8ec959ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:11.832577 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e69dd59a-a291-4bf1-8d81-2d6e8ec959ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:11.834299 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e69dd59a-a291-4bf1-8d81-2d6e8ec959ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:11.834929 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e69dd59a-a291-4bf1-8d81-2d6e8ec959ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:11.835917 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e69dd59a-a291-4bf1-8d81-2d6e8ec959ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:12.077054 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e69dd59a-a291-4bf1-8d81-2d6e8ec959ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:12.087219 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e69dd59a-a291-4bf1-8d81-2d6e8ec959ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:12.088900 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-e69dd59a-a291-4bf1-8d81-2d6e8ec959ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:12.090432 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e69dd59a-a291-4bf1-8d81-2d6e8ec959ef tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1599 microversion: 2.20 time: 0.275992 Sep 09 13:21:12.090995 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 456/914] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:11 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1599 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:21:12.117206 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c3ed69ce-9c76-4ec2-a7aa-7f13b58056bf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:12.117795 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c3ed69ce-9c76-4ec2-a7aa-7f13b58056bf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:12.125468 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3ed69ce-9c76-4ec2-a7aa-7f13b58056bf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:12.126186 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3ed69ce-9c76-4ec2-a7aa-7f13b58056bf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:12.126609 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3ed69ce-9c76-4ec2-a7aa-7f13b58056bf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:12.127380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3ed69ce-9c76-4ec2-a7aa-7f13b58056bf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:12.127839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3ed69ce-9c76-4ec2-a7aa-7f13b58056bf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:12.128269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3ed69ce-9c76-4ec2-a7aa-7f13b58056bf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:12.212938 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c3ed69ce-9c76-4ec2-a7aa-7f13b58056bf tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100401 Sep 09 13:21:12.215506 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 459/915] 10.222.0.17 () {60 vars in 1316 bytes} [Fri Sep 9 13:21:12 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 13:21:12.344167 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e071775e-8526-4c79-8436-5d7b45a928b7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Action: 'create', calling method: .version_select at 0x7fd4a4faf0d0>, body: {"keypair": {"name": "tempest-keypair-390683967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0ukbsEa0y6pyTd9wJMmw6HQQfjPas8+BFHqDW+d3TDm2jM8GLymFz1VQtHVvaNz0A+HGrw6vfwM9QMtYiPWk1LcwfKO/IU/jmOq3nutuMlOm6vqLqOT6pTGKzX9aY6eA=="}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:12.361002 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-e071775e-8526-4c79-8436-5d7b45a928b7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:21:12.365253 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-e071775e-8526-4c79-8436-5d7b45a928b7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for user dcb88983a8e1439588644b71170d7362 and project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:21:12.382428 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:12.393115 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e071775e-8526-4c79-8436-5d7b45a928b7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053759 Sep 09 13:21:12.394025 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 457/916] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 13:21:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:12.522962 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b9fb4fa8-3817-4c53-9c5e-8269706a00bd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c20c64b2-7344-46d2-a1e8-ce28ddf273fc"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:12.525349 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b9fb4fa8-3817-4c53-9c5e-8269706a00bd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:12.534021 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9fb4fa8-3817-4c53-9c5e-8269706a00bd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:12.534856 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9fb4fa8-3817-4c53-9c5e-8269706a00bd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:12.535344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9fb4fa8-3817-4c53-9c5e-8269706a00bd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:12.536041 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9fb4fa8-3817-4c53-9c5e-8269706a00bd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:12.537278 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9fb4fa8-3817-4c53-9c5e-8269706a00bd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:12.537916 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b9fb4fa8-3817-4c53-9c5e-8269706a00bd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:12.880819 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b9fb4fa8-3817-4c53-9c5e-8269706a00bd tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "POST /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361559 Sep 09 13:21:12.897462 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 460/917] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 13:21:12 2022] POST /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:13.443175 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-00acf2b3-d9e3-447e-a85a-85e3b98330dd req-4c1988a8-24a5-49d9-8e6a-eb1ea5cea916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2bed376-e738-4913-8eea-71014b54ed1f", "tag": "38c754fd-a2fb-4031-a376-b82c80b97094"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:13.456401 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-00acf2b3-d9e3-447e-a85a-85e3b98330dd req-4c1988a8-24a5-49d9-8e6a-eb1ea5cea916 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:13.457132 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-00acf2b3-d9e3-447e-a85a-85e3b98330dd req-4c1988a8-24a5-49d9-8e6a-eb1ea5cea916 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:13.457550 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-00acf2b3-d9e3-447e-a85a-85e3b98330dd req-4c1988a8-24a5-49d9-8e6a-eb1ea5cea916 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:13.469945 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-00acf2b3-d9e3-447e-a85a-85e3b98330dd req-4c1988a8-24a5-49d9-8e6a-eb1ea5cea916 service nova] Creating event network-changed:38c754fd-a2fb-4031-a376-b82c80b97094 for instance b2bed376-e738-4913-8eea-71014b54ed1f on hv-cinder-83124 Sep 09 13:21:13.475222 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-00acf2b3-d9e3-447e-a85a-85e3b98330dd req-4c1988a8-24a5-49d9-8e6a-eb1ea5cea916 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036024 Sep 09 13:21:13.476023 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 458/918] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:14.162248 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2098076330", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2956cf21-dbaf-41ce-8ac8-8e3d7c788d07"}], "security_groups": [{"name": "tempest-securitygroup--2058968570"}], "key_name": "tempest-keypair-390683967", "user_data": "}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:14.323168 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] validate_networks() for [('2956cf21-dbaf-41ce-8ac8-8e3d7c788d07', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:21:14.744549 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:21:14.744704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:21:14.745061 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:21:14.745475 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:21:14.745886 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:21:14.755659 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:14.756483 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:14.757133 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:14.757989 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:14.758444 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:14.758899 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:14.781678 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:21:14.786227 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Getting quotas for user dcb88983a8e1439588644b71170d7362 and project 6b24b42ca93941aa8e70f5fa10303f4d. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:21:14.801898 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:21:14.804357 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:21:14.864087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bfbb2d75-646b-46bb-8719-d5e539283712 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.719325 Sep 09 13:21:14.864749 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 461/919] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:21:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:21:14.878887 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ffd5db71-79c0-4fef-afc2-7dd1331b6fff tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:14.883560 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ffd5db71-79c0-4fef-afc2-7dd1331b6fff tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:14.955580 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ffd5db71-79c0-4fef-afc2-7dd1331b6fff tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:14.962603 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ffd5db71-79c0-4fef-afc2-7dd1331b6fff tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1241 microversion: 2.1 time: 0.089874 Sep 09 13:21:14.972943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 459/920] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:14 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:15.987627 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c7fac9eb-3374-425c-9a17-b8755d7fd5e5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:15.988748 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c7fac9eb-3374-425c-9a17-b8755d7fd5e5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:16.000820 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7fac9eb-3374-425c-9a17-b8755d7fd5e5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:16.001311 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7fac9eb-3374-425c-9a17-b8755d7fd5e5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:16.001745 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7fac9eb-3374-425c-9a17-b8755d7fd5e5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:16.002529 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7fac9eb-3374-425c-9a17-b8755d7fd5e5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:16.004093 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7fac9eb-3374-425c-9a17-b8755d7fd5e5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:16.004528 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c7fac9eb-3374-425c-9a17-b8755d7fd5e5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:16.103767 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c7fac9eb-3374-425c-9a17-b8755d7fd5e5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:16.118369 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c7fac9eb-3374-425c-9a17-b8755d7fd5e5 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1301 microversion: 2.1 time: 0.136039 Sep 09 13:21:16.119044 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 462/921] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:15 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1301 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:17.147629 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b3718666-57c8-42f6-be69-0083b1354f9c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:17.148245 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b3718666-57c8-42f6-be69-0083b1354f9c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:17.156560 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3718666-57c8-42f6-be69-0083b1354f9c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:17.157051 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3718666-57c8-42f6-be69-0083b1354f9c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:17.157494 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3718666-57c8-42f6-be69-0083b1354f9c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:17.158196 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3718666-57c8-42f6-be69-0083b1354f9c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:17.158651 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3718666-57c8-42f6-be69-0083b1354f9c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:17.159103 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b3718666-57c8-42f6-be69-0083b1354f9c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:17.290858 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b3718666-57c8-42f6-be69-0083b1354f9c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:17.299145 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b3718666-57c8-42f6-be69-0083b1354f9c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1367 microversion: 2.1 time: 0.155254 Sep 09 13:21:17.299785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 460/922] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:17 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:21:17.790539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-c7d0f6b0-2e62-4946-befe-cb317642e61f req-f8ab0f05-21de-4f71-bdee-9a9b1cf4ac9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fff99ec-fa72-4528-9330-ba97ee1ef932", "tag": "dd1a9f57-a793-4888-912b-f664f644cf55"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:17.809603 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c7d0f6b0-2e62-4946-befe-cb317642e61f req-f8ab0f05-21de-4f71-bdee-9a9b1cf4ac9e service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:17.813884 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c7d0f6b0-2e62-4946-befe-cb317642e61f req-f8ab0f05-21de-4f71-bdee-9a9b1cf4ac9e service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:17.814692 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-c7d0f6b0-2e62-4946-befe-cb317642e61f req-f8ab0f05-21de-4f71-bdee-9a9b1cf4ac9e service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:17.828272 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-c7d0f6b0-2e62-4946-befe-cb317642e61f req-f8ab0f05-21de-4f71-bdee-9a9b1cf4ac9e service nova] Creating event network-changed:dd1a9f57-a793-4888-912b-f664f644cf55 for instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 on hv-cinder-83124 Sep 09 13:21:17.834081 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-c7d0f6b0-2e62-4946-befe-cb317642e61f req-f8ab0f05-21de-4f71-bdee-9a9b1cf4ac9e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047035 Sep 09 13:21:17.834969 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 463/923] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:18.321822 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-edb08374-e723-4d84-8c4b-ce571f0bf755 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:18.322382 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-edb08374-e723-4d84-8c4b-ce571f0bf755 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:18.328747 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-edb08374-e723-4d84-8c4b-ce571f0bf755 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:18.329230 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-edb08374-e723-4d84-8c4b-ce571f0bf755 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:18.329665 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-edb08374-e723-4d84-8c4b-ce571f0bf755 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:18.330377 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-edb08374-e723-4d84-8c4b-ce571f0bf755 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:18.330832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-edb08374-e723-4d84-8c4b-ce571f0bf755 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:18.331287 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-edb08374-e723-4d84-8c4b-ce571f0bf755 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:18.459071 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-edb08374-e723-4d84-8c4b-ce571f0bf755 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:18.467157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-edb08374-e723-4d84-8c4b-ce571f0bf755 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1367 microversion: 2.1 time: 0.148789 Sep 09 13:21:18.467728 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 461/924] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:18 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:19.490462 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4a558418-5f2d-40b4-b011-2331d87c6664 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:19.491193 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4a558418-5f2d-40b4-b011-2331d87c6664 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:19.499163 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a558418-5f2d-40b4-b011-2331d87c6664 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:19.499795 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a558418-5f2d-40b4-b011-2331d87c6664 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:19.500360 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a558418-5f2d-40b4-b011-2331d87c6664 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:19.501126 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a558418-5f2d-40b4-b011-2331d87c6664 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:19.501646 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a558418-5f2d-40b4-b011-2331d87c6664 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:19.502205 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4a558418-5f2d-40b4-b011-2331d87c6664 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:19.666593 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4a558418-5f2d-40b4-b011-2331d87c6664 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:19.674725 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4a558418-5f2d-40b4-b011-2331d87c6664 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1367 microversion: 2.1 time: 0.188425 Sep 09 13:21:19.675419 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 464/925] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:19 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:20.697583 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-68a6fc36-9c8e-4bca-b184-58755d2223ef tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:20.698213 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-68a6fc36-9c8e-4bca-b184-58755d2223ef tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:20.705415 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68a6fc36-9c8e-4bca-b184-58755d2223ef tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:20.705912 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68a6fc36-9c8e-4bca-b184-58755d2223ef tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:20.706349 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68a6fc36-9c8e-4bca-b184-58755d2223ef tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:20.707090 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68a6fc36-9c8e-4bca-b184-58755d2223ef tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:20.707556 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68a6fc36-9c8e-4bca-b184-58755d2223ef tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:20.707986 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68a6fc36-9c8e-4bca-b184-58755d2223ef tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:20.860627 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-68a6fc36-9c8e-4bca-b184-58755d2223ef tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:20.868314 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-68a6fc36-9c8e-4bca-b184-58755d2223ef tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1367 microversion: 2.1 time: 0.174575 Sep 09 13:21:20.868876 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 462/926] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:20 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:20.901601 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7559a975-dce7-4020-aa9e-944946082624 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:20.903856 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7559a975-dce7-4020-aa9e-944946082624 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:20.910331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7559a975-dce7-4020-aa9e-944946082624 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:20.910819 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7559a975-dce7-4020-aa9e-944946082624 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:20.911302 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7559a975-dce7-4020-aa9e-944946082624 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:20.911998 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7559a975-dce7-4020-aa9e-944946082624 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:20.912455 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7559a975-dce7-4020-aa9e-944946082624 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:20.912906 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7559a975-dce7-4020-aa9e-944946082624 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:20.942743 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7559a975-dce7-4020-aa9e-944946082624 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045073 Sep 09 13:21:20.943322 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 465/927] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:21:20 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:20.953977 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-72845e84-0e54-43a1-a71c-410cdaaf9e8a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:20.954473 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-72845e84-0e54-43a1-a71c-410cdaaf9e8a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:20.960391 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72845e84-0e54-43a1-a71c-410cdaaf9e8a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:20.960877 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72845e84-0e54-43a1-a71c-410cdaaf9e8a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:20.961313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72845e84-0e54-43a1-a71c-410cdaaf9e8a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:20.961997 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72845e84-0e54-43a1-a71c-410cdaaf9e8a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:20.962452 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72845e84-0e54-43a1-a71c-410cdaaf9e8a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:20.962875 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72845e84-0e54-43a1-a71c-410cdaaf9e8a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:20.991557 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-72845e84-0e54-43a1-a71c-410cdaaf9e8a tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments/c20c64b2-7344-46d2-a1e8-ce28ddf273fc" status: 200 len: 194 microversion: 2.1 time: 0.041489 Sep 09 13:21:20.992128 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 463/928] 10.222.0.17 () {58 vars in 1413 bytes} [Fri Sep 9 13:21:20 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments/c20c64b2-7344-46d2-a1e8-ce28ddf273fc => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:21.892471 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-323a7ab0-2f62-4134-919b-b37c81fcf025 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:21.893077 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-323a7ab0-2f62-4134-919b-b37c81fcf025 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:21.899251 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-323a7ab0-2f62-4134-919b-b37c81fcf025 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:21.899744 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-323a7ab0-2f62-4134-919b-b37c81fcf025 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:21.900187 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-323a7ab0-2f62-4134-919b-b37c81fcf025 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:21.900888 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-323a7ab0-2f62-4134-919b-b37c81fcf025 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:21.901377 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-323a7ab0-2f62-4134-919b-b37c81fcf025 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:21.901803 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-323a7ab0-2f62-4134-919b-b37c81fcf025 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:22.030063 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-323a7ab0-2f62-4134-919b-b37c81fcf025 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:22.039084 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-323a7ab0-2f62-4134-919b-b37c81fcf025 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1367 microversion: 2.1 time: 0.151165 Sep 09 13:21:22.039663 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 466/929] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:21 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:23.061566 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fd809432-f473-48a0-85ea-fd5677f8a0cf tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:23.062256 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fd809432-f473-48a0-85ea-fd5677f8a0cf tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:23.069364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd809432-f473-48a0-85ea-fd5677f8a0cf tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:23.069853 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd809432-f473-48a0-85ea-fd5677f8a0cf tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:23.070288 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd809432-f473-48a0-85ea-fd5677f8a0cf tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:23.070993 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd809432-f473-48a0-85ea-fd5677f8a0cf tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:23.071478 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd809432-f473-48a0-85ea-fd5677f8a0cf tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:23.071904 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd809432-f473-48a0-85ea-fd5677f8a0cf tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:23.212986 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fd809432-f473-48a0-85ea-fd5677f8a0cf tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:23.221550 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fd809432-f473-48a0-85ea-fd5677f8a0cf tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1367 microversion: 2.1 time: 0.163796 Sep 09 13:21:23.222353 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 464/930] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:23 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:23.403076 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-beea90b3-8a16-4a31-9c17-438b6a811884 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c824e7b6-45d6-4c98-a9a8-2b3cc6257364"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:23.406833 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-beea90b3-8a16-4a31-9c17-438b6a811884 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:23.413820 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-beea90b3-8a16-4a31-9c17-438b6a811884 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:23.414305 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-beea90b3-8a16-4a31-9c17-438b6a811884 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:23.414740 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-beea90b3-8a16-4a31-9c17-438b6a811884 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:23.415563 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-beea90b3-8a16-4a31-9c17-438b6a811884 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:23.416015 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-beea90b3-8a16-4a31-9c17-438b6a811884 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:23.416488 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-beea90b3-8a16-4a31-9c17-438b6a811884 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:23.650214 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-d47cbaa8-dff1-46b9-aa7b-b127e5bf8021 req-67031794-ac1e-468c-be08-4a95be38383c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fff99ec-fa72-4528-9330-ba97ee1ef932", "name": "network-vif-plugged", "status": "completed", "tag": "dd1a9f57-a793-4888-912b-f664f644cf55"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:23.661037 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-d47cbaa8-dff1-46b9-aa7b-b127e5bf8021 req-67031794-ac1e-468c-be08-4a95be38383c service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:23.661615 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-d47cbaa8-dff1-46b9-aa7b-b127e5bf8021 req-67031794-ac1e-468c-be08-4a95be38383c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:23.662269 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-d47cbaa8-dff1-46b9-aa7b-b127e5bf8021 req-67031794-ac1e-468c-be08-4a95be38383c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:23.689389 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-d47cbaa8-dff1-46b9-aa7b-b127e5bf8021 req-67031794-ac1e-468c-be08-4a95be38383c service nova] Creating event network-vif-plugged:dd1a9f57-a793-4888-912b-f664f644cf55 for instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 on hv-cinder-83124 Sep 09 13:21:23.694822 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-d47cbaa8-dff1-46b9-aa7b-b127e5bf8021 req-67031794-ac1e-468c-be08-4a95be38383c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050599 Sep 09 13:21:23.696039 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 465/931] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:23.697463 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-beea90b3-8a16-4a31-9c17-438b6a811884 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "POST /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299784 Sep 09 13:21:23.704640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 467/932] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 13:21:23 2022] POST /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:24.245896 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0e51657b-1ee9-471d-8e39-fccc4d32510f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:24.246594 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0e51657b-1ee9-471d-8e39-fccc4d32510f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:24.253588 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0e51657b-1ee9-471d-8e39-fccc4d32510f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:24.254070 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0e51657b-1ee9-471d-8e39-fccc4d32510f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:24.254502 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0e51657b-1ee9-471d-8e39-fccc4d32510f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:24.255226 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0e51657b-1ee9-471d-8e39-fccc4d32510f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:24.255682 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0e51657b-1ee9-471d-8e39-fccc4d32510f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:24.256106 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0e51657b-1ee9-471d-8e39-fccc4d32510f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:24.321763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6247d574-9f22-42ce-9d5c-945bd96a965a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2014497034"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:24.322275 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6247d574-9f22-42ce-9d5c-945bd96a965a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:24.330522 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6247d574-9f22-42ce-9d5c-945bd96a965a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:24.331016 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6247d574-9f22-42ce-9d5c-945bd96a965a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:24.332155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6247d574-9f22-42ce-9d5c-945bd96a965a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:24.332155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6247d574-9f22-42ce-9d5c-945bd96a965a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:24.332624 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6247d574-9f22-42ce-9d5c-945bd96a965a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:24.333051 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6247d574-9f22-42ce-9d5c-945bd96a965a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:24.396399 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0e51657b-1ee9-471d-8e39-fccc4d32510f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:24.404849 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0e51657b-1ee9-471d-8e39-fccc4d32510f tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1367 microversion: 2.1 time: 0.163540 Sep 09 13:21:24.405429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 466/933] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:24 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:24.468438 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.network.security_group_api [None req-6247d574-9f22-42ce-9d5c-945bd96a965a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Removing security group 981f98ce-99d4-4fe8-b47d-a3ede9d7ed16 from port 19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f Sep 09 13:21:24.772833 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:24.796155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:24.806753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6247d574-9f22-42ce-9d5c-945bd96a965a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "POST /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/action" status: 202 len: 0 microversion: 2.1 time: 0.489459 Sep 09 13:21:24.810980 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 468/934] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 13:21:24 2022] POST /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 13:21:24.844217 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-578ef680-7910-4523-b270-4c7bde4a558c req-c6503c63-5a20-40ad-a62a-9a4819111504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d", "tag": "19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:24.857691 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-578ef680-7910-4523-b270-4c7bde4a558c req-c6503c63-5a20-40ad-a62a-9a4819111504 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:24.858584 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-578ef680-7910-4523-b270-4c7bde4a558c req-c6503c63-5a20-40ad-a62a-9a4819111504 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:24.859637 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-578ef680-7910-4523-b270-4c7bde4a558c req-c6503c63-5a20-40ad-a62a-9a4819111504 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:24.876607 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-578ef680-7910-4523-b270-4c7bde4a558c req-c6503c63-5a20-40ad-a62a-9a4819111504 service nova] Creating event network-changed:19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f for instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d on hv-cinder-83124 Sep 09 13:21:24.883433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-578ef680-7910-4523-b270-4c7bde4a558c req-c6503c63-5a20-40ad-a62a-9a4819111504 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046823 Sep 09 13:21:24.884146 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 467/935] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:25.428257 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c6c91209-e525-4172-9540-b08abd853f44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:25.428980 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c6c91209-e525-4172-9540-b08abd853f44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:25.435105 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c91209-e525-4172-9540-b08abd853f44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:25.435696 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c91209-e525-4172-9540-b08abd853f44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:25.436713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c91209-e525-4172-9540-b08abd853f44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:25.437958 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c91209-e525-4172-9540-b08abd853f44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:25.438416 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c91209-e525-4172-9540-b08abd853f44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:25.438837 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c6c91209-e525-4172-9540-b08abd853f44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:25.770632 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c6c91209-e525-4172-9540-b08abd853f44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:25.777895 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c6c91209-e525-4172-9540-b08abd853f44 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1367 microversion: 2.1 time: 0.354023 Sep 09 13:21:25.778777 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 469/936] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:25 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:26.520319 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=6 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:26.525934 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bc3186f0-f86a-44e0-803f-ef1c58788b51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:26.526807 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bc3186f0-f86a-44e0-803f-ef1c58788b51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:26.534636 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc3186f0-f86a-44e0-803f-ef1c58788b51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:26.535370 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc3186f0-f86a-44e0-803f-ef1c58788b51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:26.536103 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc3186f0-f86a-44e0-803f-ef1c58788b51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:26.537001 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc3186f0-f86a-44e0-803f-ef1c58788b51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:26.537615 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc3186f0-f86a-44e0-803f-ef1c58788b51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:26.538187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc3186f0-f86a-44e0-803f-ef1c58788b51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:26.647403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-bc3186f0-f86a-44e0-803f-ef1c58788b51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lazy-loading 'services' on Instance uuid 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:21:26.732817 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bc3186f0-f86a-44e0-803f-ef1c58788b51 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "DELETE /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments/66e4b8ac-a09f-47f9-9117-a96be38425fb" status: 202 len: 0 microversion: 2.1 time: 0.212674 Sep 09 13:21:26.734268 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 468/937] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 13:21:26 2022] DELETE /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments/66e4b8ac-a09f-47f9-9117-a96be38425fb => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:21:26.743124 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3e5d806b-63d4-4360-aa36-1d7441305313 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:26.745817 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3e5d806b-63d4-4360-aa36-1d7441305313 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:26.754422 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5d806b-63d4-4360-aa36-1d7441305313 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:26.755174 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5d806b-63d4-4360-aa36-1d7441305313 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:26.755761 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5d806b-63d4-4360-aa36-1d7441305313 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:26.756618 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5d806b-63d4-4360-aa36-1d7441305313 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:26.757221 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5d806b-63d4-4360-aa36-1d7441305313 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:26.757976 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3e5d806b-63d4-4360-aa36-1d7441305313 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:26.797369 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3e5d806b-63d4-4360-aa36-1d7441305313 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058463 Sep 09 13:21:26.798656 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 470/938] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:21:26 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:26.808079 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-13602fd5-2ee4-418b-a36c-918aa86e4dd0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:26.808910 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-13602fd5-2ee4-418b-a36c-918aa86e4dd0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:26.819684 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-13602fd5-2ee4-418b-a36c-918aa86e4dd0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:26.820179 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-13602fd5-2ee4-418b-a36c-918aa86e4dd0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:26.821957 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-13602fd5-2ee4-418b-a36c-918aa86e4dd0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:26.822703 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-13602fd5-2ee4-418b-a36c-918aa86e4dd0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:26.823197 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-13602fd5-2ee4-418b-a36c-918aa86e4dd0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:26.823628 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-13602fd5-2ee4-418b-a36c-918aa86e4dd0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:26.899172 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-8624ec1e-3724-47c9-a85a-2dd4f8ead2fa req-4e365039-fd36-479c-8d00-40bfd73a8658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d", "tag": "19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:26.910483 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8624ec1e-3724-47c9-a85a-2dd4f8ead2fa req-4e365039-fd36-479c-8d00-40bfd73a8658 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:26.911238 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8624ec1e-3724-47c9-a85a-2dd4f8ead2fa req-4e365039-fd36-479c-8d00-40bfd73a8658 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:26.911985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8624ec1e-3724-47c9-a85a-2dd4f8ead2fa req-4e365039-fd36-479c-8d00-40bfd73a8658 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:26.924527 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:26.927573 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-8624ec1e-3724-47c9-a85a-2dd4f8ead2fa req-4e365039-fd36-479c-8d00-40bfd73a8658 service nova] Creating event network-changed:19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f for instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d on hv-cinder-83124 Sep 09 13:21:26.936748 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-8624ec1e-3724-47c9-a85a-2dd4f8ead2fa req-4e365039-fd36-479c-8d00-40bfd73a8658 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041043 Sep 09 13:21:26.939215 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 471/939] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:27.046585 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-13602fd5-2ee4-418b-a36c-918aa86e4dd0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:27.067275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-13602fd5-2ee4-418b-a36c-918aa86e4dd0 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1557 microversion: 2.1 time: 0.263366 Sep 09 13:21:27.068248 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 469/940] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:26 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1557 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:27.094797 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-15fbd78f-dfcb-457c-9558-0dab446c67b4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:27.095395 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-15fbd78f-dfcb-457c-9558-0dab446c67b4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:27.102808 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15fbd78f-dfcb-457c-9558-0dab446c67b4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:27.103316 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15fbd78f-dfcb-457c-9558-0dab446c67b4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:27.103932 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15fbd78f-dfcb-457c-9558-0dab446c67b4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:27.104621 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15fbd78f-dfcb-457c-9558-0dab446c67b4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:27.105236 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15fbd78f-dfcb-457c-9558-0dab446c67b4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:27.105653 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15fbd78f-dfcb-457c-9558-0dab446c67b4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:27.236406 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-15fbd78f-dfcb-457c-9558-0dab446c67b4 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148493 Sep 09 13:21:27.237119 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 472/941] 10.222.0.17 () {58 vars in 1275 bytes} [Fri Sep 9 13:21:27 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:27.809799 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-427ce762-24e6-4501-a2df-50387f6f0c5c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:27.813153 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-427ce762-24e6-4501-a2df-50387f6f0c5c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:27.821350 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-427ce762-24e6-4501-a2df-50387f6f0c5c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:27.822003 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-427ce762-24e6-4501-a2df-50387f6f0c5c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:27.822607 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-427ce762-24e6-4501-a2df-50387f6f0c5c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:27.823647 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-427ce762-24e6-4501-a2df-50387f6f0c5c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:27.824260 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-427ce762-24e6-4501-a2df-50387f6f0c5c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:27.824962 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-427ce762-24e6-4501-a2df-50387f6f0c5c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:27.861342 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-427ce762-24e6-4501-a2df-50387f6f0c5c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055389 Sep 09 13:21:27.861928 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 470/942] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:21:27 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:28.801108 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-71bd5ad2-4a96-4ff8-9a84-64b3e5fdd521 req-a99742b1-1560-45fa-8fbb-aa78d3cc111c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fff99ec-fa72-4528-9330-ba97ee1ef932", "tag": "dd1a9f57-a793-4888-912b-f664f644cf55"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:28.811727 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-71bd5ad2-4a96-4ff8-9a84-64b3e5fdd521 req-a99742b1-1560-45fa-8fbb-aa78d3cc111c service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:28.812199 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-71bd5ad2-4a96-4ff8-9a84-64b3e5fdd521 req-a99742b1-1560-45fa-8fbb-aa78d3cc111c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:28.812630 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-71bd5ad2-4a96-4ff8-9a84-64b3e5fdd521 req-a99742b1-1560-45fa-8fbb-aa78d3cc111c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:28.823728 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-71bd5ad2-4a96-4ff8-9a84-64b3e5fdd521 req-a99742b1-1560-45fa-8fbb-aa78d3cc111c service nova] Creating event network-changed:dd1a9f57-a793-4888-912b-f664f644cf55 for instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 on hv-cinder-83124 Sep 09 13:21:28.829216 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-71bd5ad2-4a96-4ff8-9a84-64b3e5fdd521 req-a99742b1-1560-45fa-8fbb-aa78d3cc111c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263432 Sep 09 13:21:28.829810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 473/943] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:28.875084 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-38b7bb3c-5af2-4c4f-a636-7505b820514a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:28.877426 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-38b7bb3c-5af2-4c4f-a636-7505b820514a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:28.884502 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38b7bb3c-5af2-4c4f-a636-7505b820514a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:28.885039 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38b7bb3c-5af2-4c4f-a636-7505b820514a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:28.885655 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38b7bb3c-5af2-4c4f-a636-7505b820514a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:28.886357 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38b7bb3c-5af2-4c4f-a636-7505b820514a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:28.886809 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38b7bb3c-5af2-4c4f-a636-7505b820514a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:28.887441 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38b7bb3c-5af2-4c4f-a636-7505b820514a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:28.922590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-38b7bb3c-5af2-4c4f-a636-7505b820514a tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052542 Sep 09 13:21:28.927732 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 471/944] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:21:28 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:29.936684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b63466f2-04f1-4b5b-a1c6-7b794c17ce62 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:29.938920 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b63466f2-04f1-4b5b-a1c6-7b794c17ce62 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:29.945130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b63466f2-04f1-4b5b-a1c6-7b794c17ce62 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:29.945617 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b63466f2-04f1-4b5b-a1c6-7b794c17ce62 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:29.946052 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b63466f2-04f1-4b5b-a1c6-7b794c17ce62 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:29.946745 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b63466f2-04f1-4b5b-a1c6-7b794c17ce62 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:29.947229 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b63466f2-04f1-4b5b-a1c6-7b794c17ce62 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:29.947656 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b63466f2-04f1-4b5b-a1c6-7b794c17ce62 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:29.976374 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b63466f2-04f1-4b5b-a1c6-7b794c17ce62 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045066 Sep 09 13:21:29.976939 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 474/945] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:21:29 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:30.989728 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d0e16b70-926b-4a01-95a5-1812b6224635 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:30.992358 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d0e16b70-926b-4a01-95a5-1812b6224635 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:31.001431 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0e16b70-926b-4a01-95a5-1812b6224635 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:31.002865 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0e16b70-926b-4a01-95a5-1812b6224635 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:31.004037 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0e16b70-926b-4a01-95a5-1812b6224635 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:31.005054 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0e16b70-926b-4a01-95a5-1812b6224635 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:31.005627 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0e16b70-926b-4a01-95a5-1812b6224635 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:31.006165 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0e16b70-926b-4a01-95a5-1812b6224635 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:31.038731 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d0e16b70-926b-4a01-95a5-1812b6224635 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053958 Sep 09 13:21:31.039432 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 472/946] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:21:30 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:31.422811 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d1b551ab-d7c2-4c2a-a083-ffb2e978b8e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:31.424999 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d1b551ab-d7c2-4c2a-a083-ffb2e978b8e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:31.431353 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1b551ab-d7c2-4c2a-a083-ffb2e978b8e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:31.431831 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1b551ab-d7c2-4c2a-a083-ffb2e978b8e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:31.432266 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1b551ab-d7c2-4c2a-a083-ffb2e978b8e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:31.432950 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1b551ab-d7c2-4c2a-a083-ffb2e978b8e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:31.433403 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1b551ab-d7c2-4c2a-a083-ffb2e978b8e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:31.433822 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1b551ab-d7c2-4c2a-a083-ffb2e978b8e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:31.463429 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d1b551ab-d7c2-4c2a-a083-ffb2e978b8e5 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045077 Sep 09 13:21:31.463981 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 475/947] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:21:31 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:31.564552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b6c5d766-0cfc-42a9-b0ac-94832e6ae1ce tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:31.565047 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b6c5d766-0cfc-42a9-b0ac-94832e6ae1ce tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:31.571157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6c5d766-0cfc-42a9-b0ac-94832e6ae1ce tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:31.571649 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6c5d766-0cfc-42a9-b0ac-94832e6ae1ce tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:31.572088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6c5d766-0cfc-42a9-b0ac-94832e6ae1ce tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:31.572778 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6c5d766-0cfc-42a9-b0ac-94832e6ae1ce tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:31.573232 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6c5d766-0cfc-42a9-b0ac-94832e6ae1ce tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:31.573657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b6c5d766-0cfc-42a9-b0ac-94832e6ae1ce tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:31.604505 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b6c5d766-0cfc-42a9-b0ac-94832e6ae1ce tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments/c20c64b2-7344-46d2-a1e8-ce28ddf273fc" status: 200 len: 194 microversion: 2.1 time: 0.044679 Sep 09 13:21:31.605398 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 473/948] 10.222.0.17 () {58 vars in 1413 bytes} [Fri Sep 9 13:21:31 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments/c20c64b2-7344-46d2-a1e8-ce28ddf273fc => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:31.616027 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-14c24a2d-af82-4a66-84fc-02513df28893 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:31.616517 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-14c24a2d-af82-4a66-84fc-02513df28893 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:31.622562 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14c24a2d-af82-4a66-84fc-02513df28893 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:31.623034 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14c24a2d-af82-4a66-84fc-02513df28893 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:31.623679 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14c24a2d-af82-4a66-84fc-02513df28893 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:31.624823 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14c24a2d-af82-4a66-84fc-02513df28893 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:31.625266 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14c24a2d-af82-4a66-84fc-02513df28893 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:31.625717 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-14c24a2d-af82-4a66-84fc-02513df28893 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:31.706166 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-14c24a2d-af82-4a66-84fc-02513df28893 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lazy-loading 'services' on Instance uuid d890866b-c7c2-4bee-89d9-76377b78b4ba {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:21:31.776476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-14c24a2d-af82-4a66-84fc-02513df28893 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments/c20c64b2-7344-46d2-a1e8-ce28ddf273fc" status: 202 len: 0 microversion: 2.1 time: 0.164131 Sep 09 13:21:31.777051 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 476/949] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 13:21:31 2022] DELETE /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments/c20c64b2-7344-46d2-a1e8-ce28ddf273fc => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:21:32.052485 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8e6ca44f-f2f8-4ca2-a8c9-01b575a88f2b tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:32.054661 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8e6ca44f-f2f8-4ca2-a8c9-01b575a88f2b tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:32.061775 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e6ca44f-f2f8-4ca2-a8c9-01b575a88f2b tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:32.062447 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e6ca44f-f2f8-4ca2-a8c9-01b575a88f2b tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:32.062908 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e6ca44f-f2f8-4ca2-a8c9-01b575a88f2b tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:32.063638 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e6ca44f-f2f8-4ca2-a8c9-01b575a88f2b tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:32.064097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e6ca44f-f2f8-4ca2-a8c9-01b575a88f2b tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:32.064549 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8e6ca44f-f2f8-4ca2-a8c9-01b575a88f2b tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:32.096876 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8e6ca44f-f2f8-4ca2-a8c9-01b575a88f2b tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048729 Sep 09 13:21:32.097431 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 474/950] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:21:32 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:21:32.110058 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ea62ad1-1707-46f2-b05d-536d2a56b18c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:32.110753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3ea62ad1-1707-46f2-b05d-536d2a56b18c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:32.118260 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ea62ad1-1707-46f2-b05d-536d2a56b18c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:32.118827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ea62ad1-1707-46f2-b05d-536d2a56b18c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:32.119289 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ea62ad1-1707-46f2-b05d-536d2a56b18c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:32.119974 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ea62ad1-1707-46f2-b05d-536d2a56b18c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:32.120501 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ea62ad1-1707-46f2-b05d-536d2a56b18c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:32.121387 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ea62ad1-1707-46f2-b05d-536d2a56b18c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:32.199235 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3ea62ad1-1707-46f2-b05d-536d2a56b18c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] HTTP exception thrown: Instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d is not attached to volume 66e4b8ac-a09f-47f9-9117-a96be38425fb Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ea62ad1-1707-46f2-b05d-536d2a56b18c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Request method failure captured: Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments/66e4b8ac-a09f-47f9-9117-a96be38425fb HTTP/1.1 Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGz0QcbGDzezBSnmJgFZJplglww6blw1BBrdwd_JgGm36-U9xoqtsbZSTjL7y58DY39s6IA6bprsJo1HfBjfmFfjO-5T5CgbgiZVp5LHPC-3iWriSWmxF2QrxALeBmSEvsRldqkd8nDAj_DVjskPlId8nMyKX_J-t1nx1mAQrKjakRfA Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: e7c4b6192be646b38d7757960e02feda Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-TestMinimumBasicScenario-216645127 Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:21:32.202130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:21:32.203721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e7c4b6192be646b38d7757960e02feda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c4b6192be646b38d7757960e02feda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c4b6192be646b38d7757960e02feda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e7c4b6192be646b38d7757960e02feda", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:32.203721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-TestMinimumBasicScenario-216645127 Sep 09 13:21:32.203721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: e7c4b6192be646b38d7757960e02feda Sep 09 13:21:32.203721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestMinimumBasicScenario-216645127 Sep 09 13:21:32.203721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-TestMinimumBasicScenario-216645127-project Sep 09 13:21:32.203721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:21:32.203721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:21:32.203721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: b754de037a8148358efb03ffa39786d4 Sep 09 13:21:32.203721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-TestMinimumBasicScenario-216645127-project Sep 09 13:21:32.203721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:21:32.203721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d is not attached to volume 66e4b8ac-a09f-47f9-9117-a96be38425fb Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'server_id': '57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d', 'id': '66e4b8ac-a09f-47f9-9117-a96be38425fb'} Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 66e4b8ac-a09f-47f9-9117-a96be38425fb. Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:32.204545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d is not attached to volume 66e4b8ac-a09f-47f9-9117-a96be38425fb Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d is not attached to volume 66e4b8ac-a09f-47f9-9117-a96be38425fb Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:32.205704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ea62ad1-1707-46f2-b05d-536d2a56b18c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Returning 404 to user: Instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d is not attached to volume 66e4b8ac-a09f-47f9-9117-a96be38425fb {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:32.206597 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3ea62ad1-1707-46f2-b05d-536d2a56b18c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "DELETE /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments/66e4b8ac-a09f-47f9-9117-a96be38425fb" status: 404 len: 154 microversion: 2.1 time: 0.099647 Sep 09 13:21:32.206597 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 477/951] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 13:21:32 2022] DELETE /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d/os-volume_attachments/66e4b8ac-a09f-47f9-9117-a96be38425fb => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:21:32.908651 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-86e3ed3e-5fd8-44f6-a4f4-42cceac73f64 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:32.909122 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-86e3ed3e-5fd8-44f6-a4f4-42cceac73f64 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:32.915202 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-86e3ed3e-5fd8-44f6-a4f4-42cceac73f64 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:32.915743 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-86e3ed3e-5fd8-44f6-a4f4-42cceac73f64 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:32.916285 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-86e3ed3e-5fd8-44f6-a4f4-42cceac73f64 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:32.916942 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-86e3ed3e-5fd8-44f6-a4f4-42cceac73f64 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:32.917406 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-86e3ed3e-5fd8-44f6-a4f4-42cceac73f64 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:32.917835 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-86e3ed3e-5fd8-44f6-a4f4-42cceac73f64 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:32.922214 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:32.950069 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-86e3ed3e-5fd8-44f6-a4f4-42cceac73f64 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments/c824e7b6-45d6-4c98-a9a8-2b3cc6257364" status: 200 len: 194 microversion: 2.1 time: 0.048275 Sep 09 13:21:32.950921 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 475/952] 10.222.0.17 () {58 vars in 1413 bytes} [Fri Sep 9 13:21:32 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments/c824e7b6-45d6-4c98-a9a8-2b3cc6257364 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:32.961566 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-acbc7497-2abb-4884-ac43-72a14decd6fa tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:32.962070 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-acbc7497-2abb-4884-ac43-72a14decd6fa tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:32.968670 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acbc7497-2abb-4884-ac43-72a14decd6fa tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:32.969150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acbc7497-2abb-4884-ac43-72a14decd6fa tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:32.969580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acbc7497-2abb-4884-ac43-72a14decd6fa tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:32.970267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acbc7497-2abb-4884-ac43-72a14decd6fa tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:32.970713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acbc7497-2abb-4884-ac43-72a14decd6fa tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:32.971156 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-acbc7497-2abb-4884-ac43-72a14decd6fa tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:33.059196 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-acbc7497-2abb-4884-ac43-72a14decd6fa tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lazy-loading 'services' on Instance uuid d890866b-c7c2-4bee-89d9-76377b78b4ba {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:21:33.147575 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-acbc7497-2abb-4884-ac43-72a14decd6fa tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments/c824e7b6-45d6-4c98-a9a8-2b3cc6257364" status: 202 len: 0 microversion: 2.1 time: 0.189767 Sep 09 13:21:33.148211 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 478/953] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 13:21:32 2022] DELETE /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments/c824e7b6-45d6-4c98-a9a8-2b3cc6257364 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:21:33.361480 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-decdbf04-1dc6-49de-98ba-4be23aa6c64c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:33.361972 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-decdbf04-1dc6-49de-98ba-4be23aa6c64c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:33.368281 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-decdbf04-1dc6-49de-98ba-4be23aa6c64c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:33.368772 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-decdbf04-1dc6-49de-98ba-4be23aa6c64c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:33.369214 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-decdbf04-1dc6-49de-98ba-4be23aa6c64c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:33.369901 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-decdbf04-1dc6-49de-98ba-4be23aa6c64c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:33.370356 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-decdbf04-1dc6-49de-98ba-4be23aa6c64c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:33.370779 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-decdbf04-1dc6-49de-98ba-4be23aa6c64c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:33.397074 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-decdbf04-1dc6-49de-98ba-4be23aa6c64c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:21:33.476404 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-decdbf04-1dc6-49de-98ba-4be23aa6c64c tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "DELETE /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 204 len: 0 microversion: 2.1 time: 0.118989 Sep 09 13:21:33.477117 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 476/954] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:21:33 2022] DELETE /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:21:33.486568 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-277e8c6d-cc13-41e5-8043-eadc4fa295e8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:33.487306 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-277e8c6d-cc13-41e5-8043-eadc4fa295e8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:33.494168 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-277e8c6d-cc13-41e5-8043-eadc4fa295e8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:33.494653 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-277e8c6d-cc13-41e5-8043-eadc4fa295e8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:33.495112 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-277e8c6d-cc13-41e5-8043-eadc4fa295e8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:33.495804 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-277e8c6d-cc13-41e5-8043-eadc4fa295e8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:33.496256 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-277e8c6d-cc13-41e5-8043-eadc4fa295e8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:33.496678 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-277e8c6d-cc13-41e5-8043-eadc4fa295e8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:33.645283 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-277e8c6d-cc13-41e5-8043-eadc4fa295e8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:33.653584 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-277e8c6d-cc13-41e5-8043-eadc4fa295e8 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1555 microversion: 2.1 time: 0.171856 Sep 09 13:21:33.654262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 479/955] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:33 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:21:34.677930 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d801a3d6-265f-4644-9374-4167c52d61f4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:34.678644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d801a3d6-265f-4644-9374-4167c52d61f4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:34.684887 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d801a3d6-265f-4644-9374-4167c52d61f4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:34.685388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d801a3d6-265f-4644-9374-4167c52d61f4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:34.685864 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d801a3d6-265f-4644-9374-4167c52d61f4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:34.686611 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d801a3d6-265f-4644-9374-4167c52d61f4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:34.687637 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d801a3d6-265f-4644-9374-4167c52d61f4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:34.688071 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d801a3d6-265f-4644-9374-4167c52d61f4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:34.837206 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d801a3d6-265f-4644-9374-4167c52d61f4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:34.845917 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d801a3d6-265f-4644-9374-4167c52d61f4 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1555 microversion: 2.1 time: 0.172162 Sep 09 13:21:34.846488 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 477/956] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:34 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:35.871475 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-71b712dc-1db6-425d-93ae-1234710f800e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:35.872434 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-71b712dc-1db6-425d-93ae-1234710f800e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:35.874955 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:35.881128 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b712dc-1db6-425d-93ae-1234710f800e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:35.881619 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b712dc-1db6-425d-93ae-1234710f800e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:35.882046 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b712dc-1db6-425d-93ae-1234710f800e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:35.882739 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b712dc-1db6-425d-93ae-1234710f800e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:35.883217 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b712dc-1db6-425d-93ae-1234710f800e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:35.883636 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-71b712dc-1db6-425d-93ae-1234710f800e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:36.174173 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-71b712dc-1db6-425d-93ae-1234710f800e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:36.181935 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-71b712dc-1db6-425d-93ae-1234710f800e tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1555 microversion: 2.1 time: 0.316834 Sep 09 13:21:36.182521 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 480/957] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:35 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1555 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:36.318539 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-1c15d9de-ba3c-4d96-99c2-a6f6780a3f5e req-92c50257-097e-4f89-8b0c-f9628cc01725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d", "name": "network-vif-deleted", "tag": "19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:36.331292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1c15d9de-ba3c-4d96-99c2-a6f6780a3f5e req-92c50257-097e-4f89-8b0c-f9628cc01725 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:36.332648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1c15d9de-ba3c-4d96-99c2-a6f6780a3f5e req-92c50257-097e-4f89-8b0c-f9628cc01725 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:36.333265 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-1c15d9de-ba3c-4d96-99c2-a6f6780a3f5e req-92c50257-097e-4f89-8b0c-f9628cc01725 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:36.357237 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-1c15d9de-ba3c-4d96-99c2-a6f6780a3f5e req-92c50257-097e-4f89-8b0c-f9628cc01725 service nova] Creating event network-vif-deleted:19a16cd9-7424-4b4b-b2ab-f3cdd4c5d51f for instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d on hv-cinder-83124 Sep 09 13:21:36.368046 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-1c15d9de-ba3c-4d96-99c2-a6f6780a3f5e req-92c50257-097e-4f89-8b0c-f9628cc01725 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052654 Sep 09 13:21:36.368904 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 478/958] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:36.525783 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e7e688b4-e18a-4bf8-ad40-4e00ffd6e9d8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:36.527914 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e7e688b4-e18a-4bf8-ad40-4e00ffd6e9d8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:36.535117 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7e688b4-e18a-4bf8-ad40-4e00ffd6e9d8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:36.535613 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7e688b4-e18a-4bf8-ad40-4e00ffd6e9d8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:36.536043 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7e688b4-e18a-4bf8-ad40-4e00ffd6e9d8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:36.536966 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7e688b4-e18a-4bf8-ad40-4e00ffd6e9d8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:36.537419 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7e688b4-e18a-4bf8-ad40-4e00ffd6e9d8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:36.538066 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7e688b4-e18a-4bf8-ad40-4e00ffd6e9d8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:36.574230 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e7e688b4-e18a-4bf8-ad40-4e00ffd6e9d8 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052222 Sep 09 13:21:36.574807 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 481/959] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:21:36 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:21:36.731453 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a8b36e87-5d76-42b2-94be-9b40d7b3a786 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:36.734272 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a8b36e87-5d76-42b2-94be-9b40d7b3a786 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:36.740781 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a8b36e87-5d76-42b2-94be-9b40d7b3a786 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:36.741279 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a8b36e87-5d76-42b2-94be-9b40d7b3a786 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:36.741719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a8b36e87-5d76-42b2-94be-9b40d7b3a786 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:36.742432 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a8b36e87-5d76-42b2-94be-9b40d7b3a786 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:36.742883 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a8b36e87-5d76-42b2-94be-9b40d7b3a786 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:36.743552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a8b36e87-5d76-42b2-94be-9b40d7b3a786 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:36.777819 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a8b36e87-5d76-42b2-94be-9b40d7b3a786 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050718 Sep 09 13:21:36.778437 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 479/960] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:21:36 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:21:36.853779 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-862bad77-64b0-42c0-a152-fb5179c2b364 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:36.854204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-862bad77-64b0-42c0-a152-fb5179c2b364 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:36.861026 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-862bad77-64b0-42c0-a152-fb5179c2b364 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:36.861490 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-862bad77-64b0-42c0-a152-fb5179c2b364 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:36.861924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-862bad77-64b0-42c0-a152-fb5179c2b364 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:36.862625 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-862bad77-64b0-42c0-a152-fb5179c2b364 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:36.863105 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-862bad77-64b0-42c0-a152-fb5179c2b364 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:36.863525 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-862bad77-64b0-42c0-a152-fb5179c2b364 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:36.897593 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-862bad77-64b0-42c0-a152-fb5179c2b364 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:21:36.979711 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-862bad77-64b0-42c0-a152-fb5179c2b364 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 204 len: 0 microversion: 2.1 time: 0.129529 Sep 09 13:21:36.980345 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 482/961] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:21:36 2022] DELETE /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:21:36.989044 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-65853a05-8e9d-4385-8df9-746da5fb7abb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:36.989687 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-65853a05-8e9d-4385-8df9-746da5fb7abb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:36.996145 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65853a05-8e9d-4385-8df9-746da5fb7abb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:36.996633 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65853a05-8e9d-4385-8df9-746da5fb7abb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:36.997566 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65853a05-8e9d-4385-8df9-746da5fb7abb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:36.998869 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65853a05-8e9d-4385-8df9-746da5fb7abb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:36.999724 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65853a05-8e9d-4385-8df9-746da5fb7abb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:37.000160 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-65853a05-8e9d-4385-8df9-746da5fb7abb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:37.143994 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-65853a05-8e9d-4385-8df9-746da5fb7abb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:37.151837 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-65853a05-8e9d-4385-8df9-746da5fb7abb tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1671 microversion: 2.1 time: 0.166877 Sep 09 13:21:37.152407 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 480/962] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:36 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:37.206010 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-589f8ed7-2752-47b8-91f6-8df672886f74 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:37.206707 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-589f8ed7-2752-47b8-91f6-8df672886f74 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:37.212689 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589f8ed7-2752-47b8-91f6-8df672886f74 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:37.213176 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589f8ed7-2752-47b8-91f6-8df672886f74 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:37.213615 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589f8ed7-2752-47b8-91f6-8df672886f74 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:37.214323 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589f8ed7-2752-47b8-91f6-8df672886f74 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:37.214780 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589f8ed7-2752-47b8-91f6-8df672886f74 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:37.215234 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589f8ed7-2752-47b8-91f6-8df672886f74 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:37.247882 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589f8ed7-2752-47b8-91f6-8df672886f74 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:37.248916 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589f8ed7-2752-47b8-91f6-8df672886f74 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:37.249558 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-589f8ed7-2752-47b8-91f6-8df672886f74 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:37.250013 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-589f8ed7-2752-47b8-91f6-8df672886f74 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lazy-loading 'fault' on Instance uuid 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:21:37.292727 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-589f8ed7-2752-47b8-91f6-8df672886f74 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:37.301658 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-589f8ed7-2752-47b8-91f6-8df672886f74 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1348 microversion: 2.1 time: 0.099788 Sep 09 13:21:37.302225 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 483/963] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:37 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:21:38.175796 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2f88372e-d653-466b-b680-3dc7018d51ad tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:38.176406 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2f88372e-d653-466b-b680-3dc7018d51ad tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:38.183567 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f88372e-d653-466b-b680-3dc7018d51ad tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:38.184050 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f88372e-d653-466b-b680-3dc7018d51ad tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:38.184486 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f88372e-d653-466b-b680-3dc7018d51ad tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:38.185294 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f88372e-d653-466b-b680-3dc7018d51ad tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:38.185750 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f88372e-d653-466b-b680-3dc7018d51ad tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:38.186960 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f88372e-d653-466b-b680-3dc7018d51ad tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:38.326329 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8d13ca3e-7af9-4cd0-bf45-7d07079012ef tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:38.327145 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8d13ca3e-7af9-4cd0-bf45-7d07079012ef tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:38.334587 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2f88372e-d653-466b-b680-3dc7018d51ad tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:38.335117 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d13ca3e-7af9-4cd0-bf45-7d07079012ef tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:38.335860 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d13ca3e-7af9-4cd0-bf45-7d07079012ef tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:38.336453 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d13ca3e-7af9-4cd0-bf45-7d07079012ef tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:38.337377 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d13ca3e-7af9-4cd0-bf45-7d07079012ef tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:38.337830 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d13ca3e-7af9-4cd0-bf45-7d07079012ef tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:38.338484 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d13ca3e-7af9-4cd0-bf45-7d07079012ef tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:38.344406 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2f88372e-d653-466b-b680-3dc7018d51ad tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1671 microversion: 2.1 time: 0.171843 Sep 09 13:21:38.344860 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 481/964] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:38 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:21:38.372293 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d13ca3e-7af9-4cd0-bf45-7d07079012ef tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:38.373099 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d13ca3e-7af9-4cd0-bf45-7d07079012ef tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:38.374136 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8d13ca3e-7af9-4cd0-bf45-7d07079012ef tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:38.374650 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-8d13ca3e-7af9-4cd0-bf45-7d07079012ef tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lazy-loading 'fault' on Instance uuid 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:21:38.417533 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8d13ca3e-7af9-4cd0-bf45-7d07079012ef tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b754de037a8148358efb03ffa39786d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c4b6192be646b38d7757960e02feda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:38.428747 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8d13ca3e-7af9-4cd0-bf45-7d07079012ef tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 200 len: 1348 microversion: 2.1 time: 0.106771 Sep 09 13:21:38.429348 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 484/965] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:38 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 1348 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:21:39.368791 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-922ada28-5bb3-4841-abe7-03be8e84355f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:39.369418 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-922ada28-5bb3-4841-abe7-03be8e84355f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:39.376515 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-922ada28-5bb3-4841-abe7-03be8e84355f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:39.377001 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-922ada28-5bb3-4841-abe7-03be8e84355f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:39.377432 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-922ada28-5bb3-4841-abe7-03be8e84355f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:39.378127 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-922ada28-5bb3-4841-abe7-03be8e84355f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:39.378581 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-922ada28-5bb3-4841-abe7-03be8e84355f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:39.379001 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-922ada28-5bb3-4841-abe7-03be8e84355f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:39.454296 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d821a403-6906-45d7-a74a-a97054cf019d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:39.455091 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d821a403-6906-45d7-a74a-a97054cf019d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] [instance: 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:39.462930 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d821a403-6906-45d7-a74a-a97054cf019d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:39.463549 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d821a403-6906-45d7-a74a-a97054cf019d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:39.464090 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d821a403-6906-45d7-a74a-a97054cf019d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:39.464903 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d821a403-6906-45d7-a74a-a97054cf019d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:39.465464 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d821a403-6906-45d7-a74a-a97054cf019d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:39.465991 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d821a403-6906-45d7-a74a-a97054cf019d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:39.480689 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-d821a403-6906-45d7-a74a-a97054cf019d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] HTTP exception thrown: Instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d could not be found. Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d821a403-6906-45d7-a74a-a97054cf019d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Request method failure captured: Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d HTTP/1.1 Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGz0QcbGDzezBSnmJgFZJplglww6blw1BBrdwd_JgGm36-U9xoqtsbZSTjL7y58DY39s6IA6bprsJo1HfBjfmFfjO-5T5CgbgiZVp5LHPC-3iWriSWmxF2QrxALeBmSEvsRldqkd8nDAj_DVjskPlId8nMyKX_J-t1nx1mAQrKjakRfA Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: e7c4b6192be646b38d7757960e02feda Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-TestMinimumBasicScenario-216645127 Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:21:39.482687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:21:39.484539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e7c4b6192be646b38d7757960e02feda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c4b6192be646b38d7757960e02feda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c4b6192be646b38d7757960e02feda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e7c4b6192be646b38d7757960e02feda", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:39.484539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-TestMinimumBasicScenario-216645127 Sep 09 13:21:39.484539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: e7c4b6192be646b38d7757960e02feda Sep 09 13:21:39.484539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestMinimumBasicScenario-216645127 Sep 09 13:21:39.484539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-TestMinimumBasicScenario-216645127-project Sep 09 13:21:39.484539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:21:39.484539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:21:39.484539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: b754de037a8148358efb03ffa39786d4 Sep 09 13:21:39.484539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-TestMinimumBasicScenario-216645127-project Sep 09 13:21:39.484539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:21:39.484539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d could not be found. Sep 09 13:21:39.484539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d'} Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d could not be found. Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:39.485847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d could not be found. Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d could not be found. Sep 09 13:21:39.489130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:39.493668 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d821a403-6906-45d7-a74a-a97054cf019d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Returning 404 to user: Instance 57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:39.493668 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d821a403-6906-45d7-a74a-a97054cf019d tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d" status: 404 len: 111 microversion: 2.1 time: 0.034708 Sep 09 13:21:39.493668 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 485/966] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:39 2022] GET /compute/v2.1/servers/57ee3d74-0c1b-4b4e-9155-3cbf3d26e27d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 13:21:39.493668 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0497ece-d472-4919-9118-7de05f413924 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] Calling method '.version_select at 0x7fd4a17b6dc0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:39.515166 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f0497ece-d472-4919-9118-7de05f413924 tempest-TestMinimumBasicScenario-216645127 tempest-TestMinimumBasicScenario-216645127-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1174718554" status: 202 len: 0 microversion: 2.1 time: 0.025493 Sep 09 13:21:39.515721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 486/967] 10.222.0.17 () {58 vars in 1272 bytes} [Fri Sep 9 13:21:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1174718554 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 13:21:39.556398 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-922ada28-5bb3-4841-abe7-03be8e84355f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:39.566446 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-922ada28-5bb3-4841-abe7-03be8e84355f tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1671 microversion: 2.1 time: 0.201637 Sep 09 13:21:39.567033 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 482/968] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:39 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1671 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:40.341580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-ec2ced96-9730-4e8e-bd98-a041d2bf95d6 req-c3a69c52-838c-4167-b9c8-e327a32315dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d890866b-c7c2-4bee-89d9-76377b78b4ba", "name": "network-vif-deleted", "tag": "68d9165e-613f-4a10-a059-f438ba96366a"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:40.368364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ec2ced96-9730-4e8e-bd98-a041d2bf95d6 req-c3a69c52-838c-4167-b9c8-e327a32315dd service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:40.368703 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ec2ced96-9730-4e8e-bd98-a041d2bf95d6 req-c3a69c52-838c-4167-b9c8-e327a32315dd service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:40.369738 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-ec2ced96-9730-4e8e-bd98-a041d2bf95d6 req-c3a69c52-838c-4167-b9c8-e327a32315dd service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:40.387459 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-ec2ced96-9730-4e8e-bd98-a041d2bf95d6 req-c3a69c52-838c-4167-b9c8-e327a32315dd service nova] Creating event network-vif-deleted:68d9165e-613f-4a10-a059-f438ba96366a for instance d890866b-c7c2-4bee-89d9-76377b78b4ba on hv-cinder-83124 Sep 09 13:21:40.406199 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-ec2ced96-9730-4e8e-bd98-a041d2bf95d6 req-c3a69c52-838c-4167-b9c8-e327a32315dd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066298 Sep 09 13:21:40.410184 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 487/969] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:40.601848 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-01897d95-4cc1-44fd-9a86-ec60879d66bc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:40.602709 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-01897d95-4cc1-44fd-9a86-ec60879d66bc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:40.616168 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01897d95-4cc1-44fd-9a86-ec60879d66bc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:40.617005 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01897d95-4cc1-44fd-9a86-ec60879d66bc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:40.617761 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01897d95-4cc1-44fd-9a86-ec60879d66bc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:40.618633 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01897d95-4cc1-44fd-9a86-ec60879d66bc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:40.619289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01897d95-4cc1-44fd-9a86-ec60879d66bc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:40.619868 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01897d95-4cc1-44fd-9a86-ec60879d66bc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:40.657557 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01897d95-4cc1-44fd-9a86-ec60879d66bc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:40.665308 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01897d95-4cc1-44fd-9a86-ec60879d66bc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:40.665775 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-01897d95-4cc1-44fd-9a86-ec60879d66bc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:40.666246 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-01897d95-4cc1-44fd-9a86-ec60879d66bc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lazy-loading 'fault' on Instance uuid d890866b-c7c2-4bee-89d9-76377b78b4ba {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:21:40.760737 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-01897d95-4cc1-44fd-9a86-ec60879d66bc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31bb28e38864eff99fdd6938b1b89a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6fd89d622647f49bd35dcaf8ceca55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:40.774309 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-01897d95-4cc1-44fd-9a86-ec60879d66bc tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 200 len: 1327 microversion: 2.1 time: 0.179935 Sep 09 13:21:40.774919 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 483/970] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:40 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 1327 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:41.799774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d4d6f2f-1239-4b22-9eb9-676890e63df2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:41.800541 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2d4d6f2f-1239-4b22-9eb9-676890e63df2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:41.809152 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d4d6f2f-1239-4b22-9eb9-676890e63df2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:41.809875 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d4d6f2f-1239-4b22-9eb9-676890e63df2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:41.810489 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d4d6f2f-1239-4b22-9eb9-676890e63df2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:41.811775 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d4d6f2f-1239-4b22-9eb9-676890e63df2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:41.812850 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d4d6f2f-1239-4b22-9eb9-676890e63df2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:41.813485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2d4d6f2f-1239-4b22-9eb9-676890e63df2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:41.835243 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:41.836919 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2d4d6f2f-1239-4b22-9eb9-676890e63df2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] HTTP exception thrown: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d4d6f2f-1239-4b22-9eb9-676890e63df2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Request method failure captured: Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba HTTP/1.1 Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzxFyARTE8GuJ8A2wFCTz71jXhnkW3Rheqj5U3l6X1lIn34mVqSeTg-pVBvkkJMCv7yhJkmGaWSjJdorZ-tGGfXouSeKXPp5tzyKXPAVQMZ6ByFMhN1h1Cjbk7MKLr7F4UfKpFXWuowo2oED0IoFlbeSlTmswsFcPndoQkRIQUpAvGg Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 6f6fd89d622647f49bd35dcaf8ceca55 Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:21:41.838662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:21:41.840288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6f6fd89d622647f49bd35dcaf8ceca55", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:41.840288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:41.840288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 6f6fd89d622647f49bd35dcaf8ceca55 Sep 09 13:21:41.840288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:41.840288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeTestJSON-1188854027-project Sep 09 13:21:41.840288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:21:41.840288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:21:41.840288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: c31bb28e38864eff99fdd6938b1b89a0 Sep 09 13:21:41.840288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeTestJSON-1188854027-project Sep 09 13:21:41.840288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:21:41.840288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:41.840288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': 'd890866b-c7c2-4bee-89d9-76377b78b4ba'} Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:41.841401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:41.842774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:41.843994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2d4d6f2f-1239-4b22-9eb9-676890e63df2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Returning 404 to user: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:41.843994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2d4d6f2f-1239-4b22-9eb9-676890e63df2 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 404 len: 111 microversion: 2.1 time: 0.046149 Sep 09 13:21:41.843994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 488/971] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:41 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:21:41.850010 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-be99e001-78d1-43f0-8954-fb8992b471a1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '.version_select at 0x7fd4a4f5f700>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:41.878779 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-be99e001-78d1-43f0-8954-fb8992b471a1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1808366495" status: 202 len: 0 microversion: 2.1 time: 0.032743 Sep 09 13:21:41.884245 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 484/972] 10.222.0.17 () {58 vars in 1221 bytes} [Fri Sep 9 13:21:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1808366495 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:21:45.095445 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3f75d9bf-7c12-41f9-849b-12d4d52227e9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:45.096009 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3f75d9bf-7c12-41f9-849b-12d4d52227e9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:45.103772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f75d9bf-7c12-41f9-849b-12d4d52227e9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:45.104346 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f75d9bf-7c12-41f9-849b-12d4d52227e9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:45.104844 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f75d9bf-7c12-41f9-849b-12d4d52227e9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:45.105600 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f75d9bf-7c12-41f9-849b-12d4d52227e9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:45.106121 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f75d9bf-7c12-41f9-849b-12d4d52227e9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:45.106611 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3f75d9bf-7c12-41f9-849b-12d4d52227e9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:45.122069 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3f75d9bf-7c12-41f9-849b-12d4d52227e9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] HTTP exception thrown: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3f75d9bf-7c12-41f9-849b-12d4d52227e9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Request method failure captured: Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba HTTP/1.1 Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzxFyARTE8GuJ8A2wFCTz71jXhnkW3Rheqj5U3l6X1lIn34mVqSeTg-pVBvkkJMCv7yhJkmGaWSjJdorZ-tGGfXouSeKXPp5tzyKXPAVQMZ6ByFMhN1h1Cjbk7MKLr7F4UfKpFXWuowo2oED0IoFlbeSlTmswsFcPndoQkRIQUpAvGg Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 6f6fd89d622647f49bd35dcaf8ceca55 Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:21:45.124687 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:21:45.126325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6f6fd89d622647f49bd35dcaf8ceca55", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:45.126325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:45.126325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 6f6fd89d622647f49bd35dcaf8ceca55 Sep 09 13:21:45.126325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:45.126325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeTestJSON-1188854027-project Sep 09 13:21:45.126325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:21:45.126325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:21:45.126325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: c31bb28e38864eff99fdd6938b1b89a0 Sep 09 13:21:45.126325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeTestJSON-1188854027-project Sep 09 13:21:45.126325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:21:45.126325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:45.126325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': 'd890866b-c7c2-4bee-89d9-76377b78b4ba'} Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:45.127267 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:45.128773 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:45.130221 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3f75d9bf-7c12-41f9-849b-12d4d52227e9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Returning 404 to user: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:45.130221 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3f75d9bf-7c12-41f9-849b-12d4d52227e9 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 404 len: 111 microversion: 2.1 time: 0.034857 Sep 09 13:21:45.130221 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 489/973] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:21:45 2022] DELETE /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:21:45.134541 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fd8551c2-8c79-471a-89af-c02fe048b488 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:45.135262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fd8551c2-8c79-471a-89af-c02fe048b488 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d890866b-c7c2-4bee-89d9-76377b78b4ba] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:45.138040 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:45.144897 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd8551c2-8c79-471a-89af-c02fe048b488 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:45.145393 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd8551c2-8c79-471a-89af-c02fe048b488 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:45.145898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd8551c2-8c79-471a-89af-c02fe048b488 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:45.146602 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd8551c2-8c79-471a-89af-c02fe048b488 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:45.147069 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd8551c2-8c79-471a-89af-c02fe048b488 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:45.147508 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd8551c2-8c79-471a-89af-c02fe048b488 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:45.162367 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-fd8551c2-8c79-471a-89af-c02fe048b488 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] HTTP exception thrown: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fd8551c2-8c79-471a-89af-c02fe048b488 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Request method failure captured: Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba HTTP/1.1 Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxFyARTE8GuJ8A2wFCTz71jXhnkW3Rheqj5U3l6X1lIn34mVqSeTg-pVBvkkJMCv7yhJkmGaWSjJdorZ-tGGfXouSeKXPp5tzyKXPAVQMZ6ByFMhN1h1Cjbk7MKLr7F4UfKpFXWuowo2oED0IoFlbeSlTmswsFcPndoQkRIQUpAvGg Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 6f6fd89d622647f49bd35dcaf8ceca55 Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:21:45.164080 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:21:45.165677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6f6fd89d622647f49bd35dcaf8ceca55", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:45.165677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:45.165677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 6f6fd89d622647f49bd35dcaf8ceca55 Sep 09 13:21:45.165677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:45.165677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeTestJSON-1188854027-project Sep 09 13:21:45.165677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:21:45.165677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:21:45.165677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: c31bb28e38864eff99fdd6938b1b89a0 Sep 09 13:21:45.165677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeTestJSON-1188854027-project Sep 09 13:21:45.165677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:21:45.165677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:45.165677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'd890866b-c7c2-4bee-89d9-76377b78b4ba'} Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:45.166610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. Sep 09 13:21:45.167854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:45.168946 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fd8551c2-8c79-471a-89af-c02fe048b488 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Returning 404 to user: Instance d890866b-c7c2-4bee-89d9-76377b78b4ba could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:45.168946 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fd8551c2-8c79-471a-89af-c02fe048b488 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba" status: 404 len: 111 microversion: 2.1 time: 0.034727 Sep 09 13:21:45.168946 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 485/974] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:45 2022] GET /compute/v2.1/servers/d890866b-c7c2-4bee-89d9-76377b78b4ba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:21:46.317204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8388186b-d1fe-44a8-95f2-515440cbf37b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:46.318448 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8388186b-d1fe-44a8-95f2-515440cbf37b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:46.325480 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8388186b-d1fe-44a8-95f2-515440cbf37b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:46.326060 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8388186b-d1fe-44a8-95f2-515440cbf37b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:46.327295 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8388186b-d1fe-44a8-95f2-515440cbf37b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:46.328103 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8388186b-d1fe-44a8-95f2-515440cbf37b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:46.328770 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8388186b-d1fe-44a8-95f2-515440cbf37b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:46.329272 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8388186b-d1fe-44a8-95f2-515440cbf37b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:46.344759 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-8388186b-d1fe-44a8-95f2-515440cbf37b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] HTTP exception thrown: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8388186b-d1fe-44a8-95f2-515440cbf37b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Request method failure captured: Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 HTTP/1.1 Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzxFyARTE8GuJ8A2wFCTz71jXhnkW3Rheqj5U3l6X1lIn34mVqSeTg-pVBvkkJMCv7yhJkmGaWSjJdorZ-tGGfXouSeKXPp5tzyKXPAVQMZ6ByFMhN1h1Cjbk7MKLr7F4UfKpFXWuowo2oED0IoFlbeSlTmswsFcPndoQkRIQUpAvGg Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 6f6fd89d622647f49bd35dcaf8ceca55 Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:21:46.346763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:21:46.348673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6f6fd89d622647f49bd35dcaf8ceca55", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:46.348673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:46.348673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 6f6fd89d622647f49bd35dcaf8ceca55 Sep 09 13:21:46.348673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:46.348673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeTestJSON-1188854027-project Sep 09 13:21:46.348673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:21:46.348673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:21:46.348673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: c31bb28e38864eff99fdd6938b1b89a0 Sep 09 13:21:46.348673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeTestJSON-1188854027-project Sep 09 13:21:46.348673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:21:46.348673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:21:46.348673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': 'd7f12266-677e-473d-8fbd-bf3136398e58'} Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:46.349612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:21:46.351169 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:46.355578 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8388186b-d1fe-44a8-95f2-515440cbf37b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Returning 404 to user: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:46.355578 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8388186b-d1fe-44a8-95f2-515440cbf37b tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 404 len: 111 microversion: 2.1 time: 0.036842 Sep 09 13:21:46.355578 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 490/975] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:21:46 2022] DELETE /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:21:46.361608 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a52a0517-a6a2-4a13-99a3-1328771153d1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:46.362222 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a52a0517-a6a2-4a13-99a3-1328771153d1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] [instance: d7f12266-677e-473d-8fbd-bf3136398e58] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:46.368820 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a52a0517-a6a2-4a13-99a3-1328771153d1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:46.369648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a52a0517-a6a2-4a13-99a3-1328771153d1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:46.370266 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a52a0517-a6a2-4a13-99a3-1328771153d1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:46.370955 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a52a0517-a6a2-4a13-99a3-1328771153d1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:46.371463 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a52a0517-a6a2-4a13-99a3-1328771153d1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:46.371893 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a52a0517-a6a2-4a13-99a3-1328771153d1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:46.386294 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-a52a0517-a6a2-4a13-99a3-1328771153d1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] HTTP exception thrown: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a52a0517-a6a2-4a13-99a3-1328771153d1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Request method failure captured: Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 HTTP/1.1 Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxFyARTE8GuJ8A2wFCTz71jXhnkW3Rheqj5U3l6X1lIn34mVqSeTg-pVBvkkJMCv7yhJkmGaWSjJdorZ-tGGfXouSeKXPp5tzyKXPAVQMZ6ByFMhN1h1Cjbk7MKLr7F4UfKpFXWuowo2oED0IoFlbeSlTmswsFcPndoQkRIQUpAvGg Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 6f6fd89d622647f49bd35dcaf8ceca55 Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:21:46.387898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:21:46.390134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f6fd89d622647f49bd35dcaf8ceca55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6f6fd89d622647f49bd35dcaf8ceca55", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:46.390134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:46.390134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 6f6fd89d622647f49bd35dcaf8ceca55 Sep 09 13:21:46.390134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1188854027 Sep 09 13:21:46.390134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeTestJSON-1188854027-project Sep 09 13:21:46.390134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:21:46.390134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:21:46.390134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: c31bb28e38864eff99fdd6938b1b89a0 Sep 09 13:21:46.390134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeTestJSON-1188854027-project Sep 09 13:21:46.390134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:21:46.390134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:21:46.390134 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'd7f12266-677e-473d-8fbd-bf3136398e58'} Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:46.391075 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. Sep 09 13:21:46.392504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:46.393805 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a52a0517-a6a2-4a13-99a3-1328771153d1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] Returning 404 to user: Instance d7f12266-677e-473d-8fbd-bf3136398e58 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:46.393805 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a52a0517-a6a2-4a13-99a3-1328771153d1 tempest-AttachVolumeTestJSON-1188854027 tempest-AttachVolumeTestJSON-1188854027-project] 10.222.0.17 "GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58" status: 404 len: 111 microversion: 2.1 time: 0.032952 Sep 09 13:21:46.400132 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 486/976] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:46 2022] GET /compute/v2.1/servers/d7f12266-677e-473d-8fbd-bf3136398e58 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:21:50.208105 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-88c65eff-d5ed-43a7-910f-86ab078561b4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:50.211097 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-88c65eff-d5ed-43a7-910f-86ab078561b4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:50.221445 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88c65eff-d5ed-43a7-910f-86ab078561b4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:50.222946 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88c65eff-d5ed-43a7-910f-86ab078561b4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:50.223684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88c65eff-d5ed-43a7-910f-86ab078561b4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:50.224815 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88c65eff-d5ed-43a7-910f-86ab078561b4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:50.225615 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88c65eff-d5ed-43a7-910f-86ab078561b4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:50.226678 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-88c65eff-d5ed-43a7-910f-86ab078561b4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:50.276206 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-88c65eff-d5ed-43a7-910f-86ab078561b4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f/ips" status: 200 len: 152 microversion: 2.20 time: 0.353997 Sep 09 13:21:50.276795 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 491/977] 10.222.0.17 () {60 vars in 1289 bytes} [Fri Sep 9 13:21:49 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f/ips => generated 152 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:21:52.051125 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-840d4a9c-6977-42db-b86b-aed256cf123e tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] Action: 'create', calling method: .version_select at 0x7fd4a18d1310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-925432029", "metadata": {"Type": "work"}}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:52.338521 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-840d4a9c-6977-42db-b86b-aed256cf123e tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.409834 Sep 09 13:21:52.341224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 487/978] 10.222.0.17 () {60 vars in 1156 bytes} [Fri Sep 9 13:21:51 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 411 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 13:21:52.353715 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fb6e92ea-06a6-4080-995a-191250d6add1 tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] Calling method '.version_select at 0x7fd4a178adc0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:52.382657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-aad9549c-095a-423a-bc4e-1a0bf83d3258 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:52.383148 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-aad9549c-095a-423a-bc4e-1a0bf83d3258 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:52.391677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aad9549c-095a-423a-bc4e-1a0bf83d3258 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:52.392304 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aad9549c-095a-423a-bc4e-1a0bf83d3258 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:52.392748 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aad9549c-095a-423a-bc4e-1a0bf83d3258 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:52.393893 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aad9549c-095a-423a-bc4e-1a0bf83d3258 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:52.394353 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aad9549c-095a-423a-bc4e-1a0bf83d3258 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:52.394955 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-aad9549c-095a-423a-bc4e-1a0bf83d3258 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:52.409672 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fb6e92ea-06a6-4080-995a-191250d6add1 tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/864c18f7-82fe-4b07-a72f-e8e06893ef95" status: 200 len: 352 microversion: 2.1 time: 0.060513 Sep 09 13:21:52.416353 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 492/979] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:21:52 2022] GET /compute/v2.1/os-volumes/864c18f7-82fe-4b07-a72f-e8e06893ef95 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:52.420754 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-aad9549c-095a-423a-bc4e-1a0bf83d3258 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lazy-loading 'flavor' on Instance uuid 76473280-a8d1-4fed-a202-c9825247c44b {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:21:52.494025 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-aad9549c-095a-423a-bc4e-1a0bf83d3258 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "POST /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b/action" status: 202 len: 0 microversion: 2.1 time: 0.115971 Sep 09 13:21:52.494717 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 488/980] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 13:21:52 2022] POST /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 13:21:52.504108 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6295f8bd-fab6-4a43-90f7-f15b9d749add tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:52.504715 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6295f8bd-fab6-4a43-90f7-f15b9d749add tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:52.510910 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6295f8bd-fab6-4a43-90f7-f15b9d749add tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:52.511447 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6295f8bd-fab6-4a43-90f7-f15b9d749add tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:52.512123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6295f8bd-fab6-4a43-90f7-f15b9d749add tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:52.512832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6295f8bd-fab6-4a43-90f7-f15b9d749add tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:52.513294 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6295f8bd-fab6-4a43-90f7-f15b9d749add tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:52.513732 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6295f8bd-fab6-4a43-90f7-f15b9d749add tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:52.579173 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-09cdafec-6a6e-41d8-acb5-dd9954c38239 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:52.579807 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-09cdafec-6a6e-41d8-acb5-dd9954c38239 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:52.586433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09cdafec-6a6e-41d8-acb5-dd9954c38239 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:52.586817 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09cdafec-6a6e-41d8-acb5-dd9954c38239 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:52.587382 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09cdafec-6a6e-41d8-acb5-dd9954c38239 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:52.587988 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09cdafec-6a6e-41d8-acb5-dd9954c38239 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:52.588475 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09cdafec-6a6e-41d8-acb5-dd9954c38239 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:52.588877 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09cdafec-6a6e-41d8-acb5-dd9954c38239 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:52.616226 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-09cdafec-6a6e-41d8-acb5-dd9954c38239 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lazy-loading 'flavor' on Instance uuid b2bed376-e738-4913-8eea-71014b54ed1f {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:21:52.664969 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6295f8bd-fab6-4a43-90f7-f15b9d749add tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:52.673784 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6295f8bd-fab6-4a43-90f7-f15b9d749add tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1569 microversion: 2.1 time: 0.173458 Sep 09 13:21:52.674352 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 493/981] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:52 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:21:52.687776 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:21:52.814875 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-09cdafec-6a6e-41d8-acb5-dd9954c38239 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "POST /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f/action" status: 202 len: 0 microversion: 2.20 time: 0.240299 Sep 09 13:21:52.815505 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 489/982] 10.222.0.17 () {62 vars in 1319 bytes} [Fri Sep 9 13:21:52 2022] POST /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 09 13:21:52.823667 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e7155b64-ad0a-4afa-b0cc-29afc796a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:52.824273 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e7155b64-ad0a-4afa-b0cc-29afc796a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:52.830542 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7155b64-ad0a-4afa-b0cc-29afc796a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:52.831022 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7155b64-ad0a-4afa-b0cc-29afc796a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:52.831487 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7155b64-ad0a-4afa-b0cc-29afc796a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:52.832173 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7155b64-ad0a-4afa-b0cc-29afc796a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:52.832623 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7155b64-ad0a-4afa-b0cc-29afc796a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:52.833040 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7155b64-ad0a-4afa-b0cc-29afc796a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:52.963730 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e7155b64-ad0a-4afa-b0cc-29afc796a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:52.972515 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e7155b64-ad0a-4afa-b0cc-29afc796a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:52.973968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e7155b64-ad0a-4afa-b0cc-29afc796a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:52.975160 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e7155b64-ad0a-4afa-b0cc-29afc796a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.155338 Sep 09 13:21:52.975714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 494/983] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:52 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:21:53.425395 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-68ab49c0-dc70-435c-83a7-034e0a6f36c2 tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] Calling method '.version_select at 0x7fd4a13523a0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:53.472863 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-68ab49c0-dc70-435c-83a7-034e0a6f36c2 tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/864c18f7-82fe-4b07-a72f-e8e06893ef95" status: 200 len: 353 microversion: 2.1 time: 0.052473 Sep 09 13:21:53.473432 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 490/984] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:21:53 2022] GET /compute/v2.1/os-volumes/864c18f7-82fe-4b07-a72f-e8e06893ef95 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:21:53.486180 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9ccf6bc0-4ed0-4269-8e96-b0fdedee417d tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] Calling method '.version_select at 0x7fd4a180f160>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:53.533216 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9ccf6bc0-4ed0-4269-8e96-b0fdedee417d tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/864c18f7-82fe-4b07-a72f-e8e06893ef95" status: 200 len: 353 microversion: 2.1 time: 0.050768 Sep 09 13:21:53.533772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 495/985] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:21:53 2022] GET /compute/v2.1/os-volumes/864c18f7-82fe-4b07-a72f-e8e06893ef95 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:21:53.547011 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f617b5f9-668e-4cf7-9a8d-7f1a07262a21 tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] Calling method '.version_select at 0x7fd4a1352ee0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:53.611779 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f617b5f9-668e-4cf7-9a8d-7f1a07262a21 tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/864c18f7-82fe-4b07-a72f-e8e06893ef95" status: 202 len: 0 microversion: 2.1 time: 0.068683 Sep 09 13:21:53.612464 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 491/986] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 13:21:53 2022] DELETE /compute/v2.1/os-volumes/864c18f7-82fe-4b07-a72f-e8e06893ef95 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:21:53.620544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-16788838-d3b4-4e87-877f-c72ac0834d5a tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] Calling method '.version_select at 0x7fd4a513d3a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:53.668939 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-16788838-d3b4-4e87-877f-c72ac0834d5a tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/864c18f7-82fe-4b07-a72f-e8e06893ef95" status: 200 len: 352 microversion: 2.1 time: 0.052139 Sep 09 13:21:53.669532 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 496/987] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:21:53 2022] GET /compute/v2.1/os-volumes/864c18f7-82fe-4b07-a72f-e8e06893ef95 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:21:53.697492 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3e1723b7-27e2-4725-a162-0ac1c6e200c1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:53.698153 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3e1723b7-27e2-4725-a162-0ac1c6e200c1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:53.705400 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e1723b7-27e2-4725-a162-0ac1c6e200c1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:53.705876 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e1723b7-27e2-4725-a162-0ac1c6e200c1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:53.706310 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e1723b7-27e2-4725-a162-0ac1c6e200c1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:53.706991 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e1723b7-27e2-4725-a162-0ac1c6e200c1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:53.707465 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e1723b7-27e2-4725-a162-0ac1c6e200c1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:53.707885 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3e1723b7-27e2-4725-a162-0ac1c6e200c1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:53.847246 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3e1723b7-27e2-4725-a162-0ac1c6e200c1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:53.855555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3e1723b7-27e2-4725-a162-0ac1c6e200c1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1569 microversion: 2.1 time: 0.161867 Sep 09 13:21:53.856158 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 492/988] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:53 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:54.001062 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9e3ac0f7-eebb-40b2-adea-8734b214f0ea tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:54.001608 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9e3ac0f7-eebb-40b2-adea-8734b214f0ea tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:54.008417 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e3ac0f7-eebb-40b2-adea-8734b214f0ea tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:54.008923 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e3ac0f7-eebb-40b2-adea-8734b214f0ea tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:54.009352 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e3ac0f7-eebb-40b2-adea-8734b214f0ea tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:54.010034 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e3ac0f7-eebb-40b2-adea-8734b214f0ea tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:54.010484 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e3ac0f7-eebb-40b2-adea-8734b214f0ea tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:54.010904 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9e3ac0f7-eebb-40b2-adea-8734b214f0ea tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:54.145379 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9e3ac0f7-eebb-40b2-adea-8734b214f0ea tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:54.153287 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9e3ac0f7-eebb-40b2-adea-8734b214f0ea tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:54.154941 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9e3ac0f7-eebb-40b2-adea-8734b214f0ea tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:54.156236 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9e3ac0f7-eebb-40b2-adea-8734b214f0ea tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.160198 Sep 09 13:21:54.156792 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 497/989] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:53 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:21:54.684074 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f3f78987-5e28-4746-9b85-019923f95f3c tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] Calling method '.version_select at 0x7fd4a5157940>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:54.712771 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-f3f78987-5e28-4746-9b85-019923f95f3c tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] HTTP exception thrown: Volume 864c18f7-82fe-4b07-a72f-e8e06893ef95 could not be found. Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f3f78987-5e28-4746-9b85-019923f95f3c tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] Request method failure captured: Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/os-volumes/864c18f7-82fe-4b07-a72f-e8e06893ef95 HTTP/1.1 Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGz3vlHH6NM7Ody1W2S1dnCmX33NyKASYEcqRErFdl20LiTMMf-8Qhoz6GLyv2dcC_mlSEDBCjJeF3qGYygBAexeakdXvZau-5v3VWwNyj5GbtMEkui5EWjBgP5ApEBX4Dj2lzyVZBML0hqP4OUhlMIN_iupCQaWBFeYsW9cf7hcmXRo Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 92288a0a820448ebb59f681cc69436bf Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-VolumesGetTestJSON-181765945 Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:21:54.714913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:21:54.716625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/92288a0a820448ebb59f681cc69436bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92288a0a820448ebb59f681cc69436bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92288a0a820448ebb59f681cc69436bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_92288a0a820448ebb59f681cc69436bf", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:54.716625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-VolumesGetTestJSON-181765945 Sep 09 13:21:54.716625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 92288a0a820448ebb59f681cc69436bf Sep 09 13:21:54.716625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-VolumesGetTestJSON-181765945 Sep 09 13:21:54.716625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-VolumesGetTestJSON-181765945-project Sep 09 13:21:54.716625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:21:54.716625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:21:54.716625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: caac4a78a3ee48b9bb554606304bf468 Sep 09 13:21:54.716625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-VolumesGetTestJSON-181765945-project Sep 09 13:21:54.716625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: Sep 09 13:21:54.716625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Volume 864c18f7-82fe-4b07-a72f-e8e06893ef95 could not be found. Sep 09 13:21:54.716625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '864c18f7-82fe-4b07-a72f-e8e06893ef95'} Sep 09 13:21:54.716625 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 864c18f7-82fe-4b07-a72f-e8e06893ef95 could not be found. (HTTP 404) (Request-ID: req-37ba6235-59d8-4d31-b3b3-85afe4393764) Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:54.718646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:21:54.720137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 864c18f7-82fe-4b07-a72f-e8e06893ef95 could not be found. Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 13:21:54.721531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:21:54.723450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 864c18f7-82fe-4b07-a72f-e8e06893ef95 could not be found. Sep 09 13:21:54.723450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:54.723450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:54.723450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:54.723450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:54.723450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:54.723450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:54.723450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:54.723450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:54.723450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 864c18f7-82fe-4b07-a72f-e8e06893ef95 could not be found. Sep 09 13:21:54.723450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:54.723450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f3f78987-5e28-4746-9b85-019923f95f3c tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] Returning 404 to user: Volume 864c18f7-82fe-4b07-a72f-e8e06893ef95 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:54.723450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f3f78987-5e28-4746-9b85-019923f95f3c tempest-VolumesGetTestJSON-181765945 tempest-VolumesGetTestJSON-181765945-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/864c18f7-82fe-4b07-a72f-e8e06893ef95" status: 404 len: 109 microversion: 2.1 time: 0.036151 Sep 09 13:21:54.723450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 493/990] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:21:54 2022] GET /compute/v2.1/os-volumes/864c18f7-82fe-4b07-a72f-e8e06893ef95 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:21:54.879856 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d04dbb69-3424-482b-b316-5f0e3061ce7d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:54.880961 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d04dbb69-3424-482b-b316-5f0e3061ce7d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:54.886857 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d04dbb69-3424-482b-b316-5f0e3061ce7d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:54.887386 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d04dbb69-3424-482b-b316-5f0e3061ce7d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:54.887822 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d04dbb69-3424-482b-b316-5f0e3061ce7d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:54.888521 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d04dbb69-3424-482b-b316-5f0e3061ce7d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:54.889530 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d04dbb69-3424-482b-b316-5f0e3061ce7d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:54.889960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d04dbb69-3424-482b-b316-5f0e3061ce7d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:55.029142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d04dbb69-3424-482b-b316-5f0e3061ce7d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:55.037686 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d04dbb69-3424-482b-b316-5f0e3061ce7d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1569 microversion: 2.1 time: 0.161825 Sep 09 13:21:55.038262 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 498/991] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:54 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:55.181925 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b7019e01-f6ea-4da4-bcec-9d99fdd07011 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:55.182562 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b7019e01-f6ea-4da4-bcec-9d99fdd07011 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:55.189560 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b7019e01-f6ea-4da4-bcec-9d99fdd07011 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:55.190043 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b7019e01-f6ea-4da4-bcec-9d99fdd07011 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:55.190480 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b7019e01-f6ea-4da4-bcec-9d99fdd07011 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:55.191202 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b7019e01-f6ea-4da4-bcec-9d99fdd07011 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:55.191658 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b7019e01-f6ea-4da4-bcec-9d99fdd07011 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:55.192083 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b7019e01-f6ea-4da4-bcec-9d99fdd07011 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:55.324893 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b7019e01-f6ea-4da4-bcec-9d99fdd07011 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:55.333674 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b7019e01-f6ea-4da4-bcec-9d99fdd07011 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:55.335156 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b7019e01-f6ea-4da4-bcec-9d99fdd07011 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:55.336540 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b7019e01-f6ea-4da4-bcec-9d99fdd07011 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.158619 Sep 09 13:21:55.337137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 494/992] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:55 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:21:56.061825 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b161b28c-c01c-41b9-a3f1-a7125bb46108 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:56.063960 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b161b28c-c01c-41b9-a3f1-a7125bb46108 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:56.071723 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b161b28c-c01c-41b9-a3f1-a7125bb46108 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:56.072201 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b161b28c-c01c-41b9-a3f1-a7125bb46108 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:56.072634 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b161b28c-c01c-41b9-a3f1-a7125bb46108 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:56.073320 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b161b28c-c01c-41b9-a3f1-a7125bb46108 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:56.073770 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b161b28c-c01c-41b9-a3f1-a7125bb46108 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:56.074188 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b161b28c-c01c-41b9-a3f1-a7125bb46108 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:56.118356 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c7c33a7c-d87e-4151-8072-e9f8ab2eed8e tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Action: 'create', calling method: .version_select at 0x7fd4a185fca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1291159649", "metadata": {"Type": "work"}}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c7c33a7c-d87e-4151-8072-e9f8ab2eed8e tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Request method failure captured: Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 122 Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGz3zcNirLHTi1Icry5q09s1PxiaBMo-DrUB6SG-goSsJ-HJdWv823Qrf8kvNK3-jH2rgp2tD7-dDBtnDl9pW1O2iSABjiyJ27xUpOH10YOpQKKKjsyATYMKYbhMlJqYd1WrIh1EgmSZ_YXUQwWenNVqP_lBqUiyXUQk1BSP5_hxghvQ Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: e7c2f682d0b54c62b5b3c205eddc94d4 Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:21:56.127570 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:21:56.129100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e7c2f682d0b54c62b5b3c205eddc94d4", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:56.129100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.129100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: e7c2f682d0b54c62b5b3c205eddc94d4 Sep 09 13:21:56.129100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.129100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesNegativeTest-1470152814-project Sep 09 13:21:56.129100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:21:56.129100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:21:56.129100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: a6785496679a44d49afee7dc806a7ddf Sep 09 13:21:56.129100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesNegativeTest-1470152814-project Sep 09 13:21:56.129100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Sep 09 13:21:56.129100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1291159649", "metadata": {"Type": "work"}}} Sep 09 13:21:56.129100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: Sep 09 13:21:56.129100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1291159649', 'metadata': {'Type': 'work'}}}} Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi '#$%' Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:56.130100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 13:21:56.131579 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 13:21:56.132841 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 13:21:56.132841 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.132841 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c7c33a7c-d87e-4151-8072-e9f8ab2eed8e tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:56.132841 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c7c33a7c-d87e-4151-8072-e9f8ab2eed8e tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.133079 Sep 09 13:21:56.132841 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 499/993] 10.222.0.17 () {60 vars in 1156 bytes} [Fri Sep 9 13:21:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:21:56.138232 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba2b6abc-f4dc-4796-9e8c-602768525272 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Action: 'create', calling method: .version_select at 0x7fd4a1868670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-20590248", "metadata": {"Type": "work"}}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba2b6abc-f4dc-4796-9e8c-602768525272 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Request method failure captured: Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 118 Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGz3zcNirLHTi1Icry5q09s1PxiaBMo-DrUB6SG-goSsJ-HJdWv823Qrf8kvNK3-jH2rgp2tD7-dDBtnDl9pW1O2iSABjiyJ27xUpOH10YOpQKKKjsyATYMKYbhMlJqYd1WrIh1EgmSZ_YXUQwWenNVqP_lBqUiyXUQk1BSP5_hxghvQ Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: e7c2f682d0b54c62b5b3c205eddc94d4 Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:21:56.144350 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:21:56.146055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e7c2f682d0b54c62b5b3c205eddc94d4", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:56.146055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.146055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: e7c2f682d0b54c62b5b3c205eddc94d4 Sep 09 13:21:56.146055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.146055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesNegativeTest-1470152814-project Sep 09 13:21:56.146055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:21:56.146055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:21:56.146055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: a6785496679a44d49afee7dc806a7ddf Sep 09 13:21:56.146055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesNegativeTest-1470152814-project Sep 09 13:21:56.146055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Sep 09 13:21:56.146055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-20590248", "metadata": {"Type": "work"}}} Sep 09 13:21:56.146055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: Sep 09 13:21:56.146055 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-20590248', 'metadata': {'Type': 'work'}}}} Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi '0' Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:56.147284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 13:21:56.148704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 13:21:56.149995 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 13:21:56.149995 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.149995 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ba2b6abc-f4dc-4796-9e8c-602768525272 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:56.149995 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ba2b6abc-f4dc-4796-9e8c-602768525272 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011137 Sep 09 13:21:56.149995 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 500/994] 10.222.0.17 () {60 vars in 1156 bytes} [Fri Sep 9 13:21:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 09 13:21:56.155490 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-413fd241-3a92-4b53-8bfc-4fb80d1ace21 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Action: 'create', calling method: .version_select at 0x7fd4a178aee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-768826831", "metadata": {"Type": "work"}}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-413fd241-3a92-4b53-8bfc-4fb80d1ace21 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Request method failure captured: Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 118 Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGz3zcNirLHTi1Icry5q09s1PxiaBMo-DrUB6SG-goSsJ-HJdWv823Qrf8kvNK3-jH2rgp2tD7-dDBtnDl9pW1O2iSABjiyJ27xUpOH10YOpQKKKjsyATYMKYbhMlJqYd1WrIh1EgmSZ_YXUQwWenNVqP_lBqUiyXUQk1BSP5_hxghvQ Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: e7c2f682d0b54c62b5b3c205eddc94d4 Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:21:56.159482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:21:56.161075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e7c2f682d0b54c62b5b3c205eddc94d4", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:56.161075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.161075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: e7c2f682d0b54c62b5b3c205eddc94d4 Sep 09 13:21:56.161075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.161075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesNegativeTest-1470152814-project Sep 09 13:21:56.161075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:21:56.161075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:21:56.161075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: a6785496679a44d49afee7dc806a7ddf Sep 09 13:21:56.161075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesNegativeTest-1470152814-project Sep 09 13:21:56.161075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Sep 09 13:21:56.161075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-768826831", "metadata": {"Type": "work"}}} Sep 09 13:21:56.161075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: Sep 09 13:21:56.161075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-768826831', 'metadata': {'Type': 'work'}}}} Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise error Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi '' Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:56.161921 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 13:21:56.163594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 13:21:56.165002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 13:21:56.165002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.165002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-413fd241-3a92-4b53-8bfc-4fb80d1ace21 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:56.165002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-413fd241-3a92-4b53-8bfc-4fb80d1ace21 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008937 Sep 09 13:21:56.165002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 501/995] 10.222.0.17 () {60 vars in 1156 bytes} [Fri Sep 9 13:21:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:21:56.171750 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-444c1582-c4ac-4ff6-88a0-4fa0de6be66c tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Calling method '.version_select at 0x7fd4a180f310>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:56.201366 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-444c1582-c4ac-4ff6-88a0-4fa0de6be66c tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] HTTP exception thrown: Volume tempest-invalid-1452165031 could not be found. Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-444c1582-c4ac-4ff6-88a0-4fa0de6be66c tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Request method failure captured: Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1452165031 HTTP/1.1 Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGz3zcNirLHTi1Icry5q09s1PxiaBMo-DrUB6SG-goSsJ-HJdWv823Qrf8kvNK3-jH2rgp2tD7-dDBtnDl9pW1O2iSABjiyJ27xUpOH10YOpQKKKjsyATYMKYbhMlJqYd1WrIh1EgmSZ_YXUQwWenNVqP_lBqUiyXUQk1BSP5_hxghvQ Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: e7c2f682d0b54c62b5b3c205eddc94d4 Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:21:56.203479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:21:56.205025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e7c2f682d0b54c62b5b3c205eddc94d4", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:56.205025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.205025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: e7c2f682d0b54c62b5b3c205eddc94d4 Sep 09 13:21:56.205025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.205025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesNegativeTest-1470152814-project Sep 09 13:21:56.205025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:21:56.205025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:21:56.205025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: a6785496679a44d49afee7dc806a7ddf Sep 09 13:21:56.205025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesNegativeTest-1470152814-project Sep 09 13:21:56.205025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: Sep 09 13:21:56.205025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Volume tempest-invalid-1452165031 could not be found. Sep 09 13:21:56.205025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': 'tempest-invalid-1452165031'} Sep 09 13:21:56.205025 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1452165031 could not be found. (HTTP 404) (Request-ID: req-04c87c60-cb65-484e-9f39-2fc526598bb3) Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.205985 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 13:21:56.207567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1452165031 could not be found. Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:21:56.208970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1452165031 could not be found. Sep 09 13:21:56.210413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.210413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.210413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.210413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.210413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:56.210413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:56.210413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:56.210413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:56.210413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1452165031 could not be found. Sep 09 13:21:56.210413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.210413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-444c1582-c4ac-4ff6-88a0-4fa0de6be66c tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Returning 404 to user: Volume tempest-invalid-1452165031 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:56.210413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-444c1582-c4ac-4ff6-88a0-4fa0de6be66c tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1452165031" status: 404 len: 99 microversion: 2.1 time: 0.037767 Sep 09 13:21:56.210413 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 502/996] 10.222.0.17 () {58 vars in 1218 bytes} [Fri Sep 9 13:21:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1452165031 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 09 13:21:56.217260 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-63d7fa1f-3513-4e49-bf4e-0e15bf1ca788 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003714 Sep 09 13:21:56.217755 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b161b28c-c01c-41b9-a3f1-a7125bb46108 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:56.218027 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 503/997] 10.222.0.17 () {58 vars in 1140 bytes} [Fri Sep 9 13:21:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 09 13:21:56.225964 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b161b28c-c01c-41b9-a3f1-a7125bb46108 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1569 microversion: 2.1 time: 0.168595 Sep 09 13:21:56.226270 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9b822c7b-1ddf-4c7f-ae2e-6d1f1b4add3c tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003433 Sep 09 13:21:56.226521 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 495/998] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:56 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:21:56.226998 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 504/999] 10.222.0.17 () {58 vars in 1137 bytes} [Fri Sep 9 13:21:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 13:21:56.235989 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ae5df76f-367d-4509-afdf-0999cb7d2086 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Calling method '.version_select at 0x7fd4a13843a0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:56.264731 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-ae5df76f-367d-4509-afdf-0999cb7d2086 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] HTTP exception thrown: Volume e42a9f61-7077-4686-95e0-daf638ecdacd could not be found. Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ae5df76f-367d-4509-afdf-0999cb7d2086 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Request method failure captured: Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: DELETE /compute/v2.1/os-volumes/e42a9f61-7077-4686-95e0-daf638ecdacd HTTP/1.1 Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGz3zcNirLHTi1Icry5q09s1PxiaBMo-DrUB6SG-goSsJ-HJdWv823Qrf8kvNK3-jH2rgp2tD7-dDBtnDl9pW1O2iSABjiyJ27xUpOH10YOpQKKKjsyATYMKYbhMlJqYd1WrIh1EgmSZ_YXUQwWenNVqP_lBqUiyXUQk1BSP5_hxghvQ Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: e7c2f682d0b54c62b5b3c205eddc94d4 Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:21:56.266713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:21:56.268403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e7c2f682d0b54c62b5b3c205eddc94d4", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:56.268403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.268403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: e7c2f682d0b54c62b5b3c205eddc94d4 Sep 09 13:21:56.268403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.268403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-VolumesNegativeTest-1470152814-project Sep 09 13:21:56.268403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:21:56.268403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:21:56.268403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: a6785496679a44d49afee7dc806a7ddf Sep 09 13:21:56.268403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-VolumesNegativeTest-1470152814-project Sep 09 13:21:56.268403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: Sep 09 13:21:56.268403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Volume e42a9f61-7077-4686-95e0-daf638ecdacd could not be found. Sep 09 13:21:56.268403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'e42a9f61-7077-4686-95e0-daf638ecdacd'} Sep 09 13:21:56.268403 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e42a9f61-7077-4686-95e0-daf638ecdacd could not be found. (HTTP 404) (Request-ID: req-5aafccc7-52e3-4c45-aa72-94a27306bc61) Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.269368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 13:21:56.270777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e42a9f61-7077-4686-95e0-daf638ecdacd could not be found. Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 13:21:56.272209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:21:56.273726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e42a9f61-7077-4686-95e0-daf638ecdacd could not be found. Sep 09 13:21:56.273726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.273726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.273726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.273726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.273726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:56.273726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:56.273726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:56.273726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:56.273726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e42a9f61-7077-4686-95e0-daf638ecdacd could not be found. Sep 09 13:21:56.273726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.273726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ae5df76f-367d-4509-afdf-0999cb7d2086 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Returning 404 to user: Volume e42a9f61-7077-4686-95e0-daf638ecdacd could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:56.273726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ae5df76f-367d-4509-afdf-0999cb7d2086 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/e42a9f61-7077-4686-95e0-daf638ecdacd" status: 404 len: 109 microversion: 2.1 time: 0.036588 Sep 09 13:21:56.273726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 496/1000] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 13:21:56 2022] DELETE /compute/v2.1/os-volumes/e42a9f61-7077-4686-95e0-daf638ecdacd => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:21:56.279932 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0a9ccd5-74b7-4007-9552-cea86f07cb91 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Calling method '.version_select at 0x7fd4a513d670>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:56.307596 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-f0a9ccd5-74b7-4007-9552-cea86f07cb91 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] HTTP exception thrown: Volume bd3d7860-44ea-4527-8d0e-c99ad7479d2b could not be found. Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0a9ccd5-74b7-4007-9552-cea86f07cb91 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Request method failure captured: Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/os-volumes/bd3d7860-44ea-4527-8d0e-c99ad7479d2b HTTP/1.1 Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGz3zcNirLHTi1Icry5q09s1PxiaBMo-DrUB6SG-goSsJ-HJdWv823Qrf8kvNK3-jH2rgp2tD7-dDBtnDl9pW1O2iSABjiyJ27xUpOH10YOpQKKKjsyATYMKYbhMlJqYd1WrIh1EgmSZ_YXUQwWenNVqP_lBqUiyXUQk1BSP5_hxghvQ Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: e7c2f682d0b54c62b5b3c205eddc94d4 Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:21:56.309553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:21:56.311839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e7c2f682d0b54c62b5b3c205eddc94d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e7c2f682d0b54c62b5b3c205eddc94d4", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:21:56.311839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.311839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: e7c2f682d0b54c62b5b3c205eddc94d4 Sep 09 13:21:56.311839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesNegativeTest-1470152814 Sep 09 13:21:56.311839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesNegativeTest-1470152814-project Sep 09 13:21:56.311839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:21:56.311839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:21:56.311839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: a6785496679a44d49afee7dc806a7ddf Sep 09 13:21:56.311839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesNegativeTest-1470152814-project Sep 09 13:21:56.311839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: Sep 09 13:21:56.311839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Volume bd3d7860-44ea-4527-8d0e-c99ad7479d2b could not be found. Sep 09 13:21:56.311839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': 'bd3d7860-44ea-4527-8d0e-c99ad7479d2b'} Sep 09 13:21:56.311839 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd3d7860-44ea-4527-8d0e-c99ad7479d2b could not be found. (HTTP 404) (Request-ID: req-62b8d0dd-5a5e-4e5a-a631-61f55566eb63) Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.312713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 13:21:56.314064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd3d7860-44ea-4527-8d0e-c99ad7479d2b could not be found. Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 13:21:56.315442 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:21:56.316869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd3d7860-44ea-4527-8d0e-c99ad7479d2b could not be found. Sep 09 13:21:56.316869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.316869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:21:56.316869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.316869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:21:56.316869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:21:56.316869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:21:56.316869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:21:56.316869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:21:56.316869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd3d7860-44ea-4527-8d0e-c99ad7479d2b could not be found. Sep 09 13:21:56.316869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:21:56.316869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f0a9ccd5-74b7-4007-9552-cea86f07cb91 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] Returning 404 to user: Volume bd3d7860-44ea-4527-8d0e-c99ad7479d2b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:21:56.316869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f0a9ccd5-74b7-4007-9552-cea86f07cb91 tempest-VolumesNegativeTest-1470152814 tempest-VolumesNegativeTest-1470152814-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/bd3d7860-44ea-4527-8d0e-c99ad7479d2b" status: 404 len: 109 microversion: 2.1 time: 0.034751 Sep 09 13:21:56.316869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 505/1001] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:21:56 2022] GET /compute/v2.1/os-volumes/bd3d7860-44ea-4527-8d0e-c99ad7479d2b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:21:56.363666 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9b5d4e03-9cfd-4ed2-b4ec-bb3b6638ce12 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:56.364269 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9b5d4e03-9cfd-4ed2-b4ec-bb3b6638ce12 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:56.370924 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b5d4e03-9cfd-4ed2-b4ec-bb3b6638ce12 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:56.371556 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b5d4e03-9cfd-4ed2-b4ec-bb3b6638ce12 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:56.371985 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b5d4e03-9cfd-4ed2-b4ec-bb3b6638ce12 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:56.372919 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b5d4e03-9cfd-4ed2-b4ec-bb3b6638ce12 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:56.374133 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b5d4e03-9cfd-4ed2-b4ec-bb3b6638ce12 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:56.374834 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9b5d4e03-9cfd-4ed2-b4ec-bb3b6638ce12 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:56.514819 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9b5d4e03-9cfd-4ed2-b4ec-bb3b6638ce12 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:56.523788 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9b5d4e03-9cfd-4ed2-b4ec-bb3b6638ce12 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:56.525231 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9b5d4e03-9cfd-4ed2-b4ec-bb3b6638ce12 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:56.526392 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9b5d4e03-9cfd-4ed2-b4ec-bb3b6638ce12 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.166553 Sep 09 13:21:56.526940 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 497/1002] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:56 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:21:57.251588 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cda44fe2-a611-49c4-a1ba-63f60f1c9401 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:57.252194 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cda44fe2-a611-49c4-a1ba-63f60f1c9401 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:57.258855 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda44fe2-a611-49c4-a1ba-63f60f1c9401 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:57.259360 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda44fe2-a611-49c4-a1ba-63f60f1c9401 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:57.259781 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda44fe2-a611-49c4-a1ba-63f60f1c9401 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:57.260499 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda44fe2-a611-49c4-a1ba-63f60f1c9401 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:57.260954 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda44fe2-a611-49c4-a1ba-63f60f1c9401 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:57.261373 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cda44fe2-a611-49c4-a1ba-63f60f1c9401 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:57.397757 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cda44fe2-a611-49c4-a1ba-63f60f1c9401 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:57.405735 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cda44fe2-a611-49c4-a1ba-63f60f1c9401 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1569 microversion: 2.1 time: 0.160424 Sep 09 13:21:57.406295 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 506/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:57 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:57.553856 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1bdd7e7d-1b91-4972-bb5e-20a340d78b69 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:57.554564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1bdd7e7d-1b91-4972-bb5e-20a340d78b69 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:57.562121 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bdd7e7d-1b91-4972-bb5e-20a340d78b69 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:57.562492 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bdd7e7d-1b91-4972-bb5e-20a340d78b69 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:57.562919 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bdd7e7d-1b91-4972-bb5e-20a340d78b69 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:57.563671 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bdd7e7d-1b91-4972-bb5e-20a340d78b69 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:57.564130 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bdd7e7d-1b91-4972-bb5e-20a340d78b69 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:57.564561 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1bdd7e7d-1b91-4972-bb5e-20a340d78b69 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:57.711071 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1bdd7e7d-1b91-4972-bb5e-20a340d78b69 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:57.721108 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1bdd7e7d-1b91-4972-bb5e-20a340d78b69 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:57.722554 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1bdd7e7d-1b91-4972-bb5e-20a340d78b69 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:57.723745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1bdd7e7d-1b91-4972-bb5e-20a340d78b69 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.173860 Sep 09 13:21:57.724301 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 498/1004] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:57 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:21:58.429720 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-549c96be-0aab-473a-9680-a04b47a827ee tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:58.430363 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-549c96be-0aab-473a-9680-a04b47a827ee tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:58.437114 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-549c96be-0aab-473a-9680-a04b47a827ee tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:58.437604 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-549c96be-0aab-473a-9680-a04b47a827ee tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:58.438037 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-549c96be-0aab-473a-9680-a04b47a827ee tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:58.438737 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-549c96be-0aab-473a-9680-a04b47a827ee tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:58.439223 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-549c96be-0aab-473a-9680-a04b47a827ee tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:58.439649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-549c96be-0aab-473a-9680-a04b47a827ee tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:58.668146 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-549c96be-0aab-473a-9680-a04b47a827ee tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:58.677490 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-549c96be-0aab-473a-9680-a04b47a827ee tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1569 microversion: 2.1 time: 0.251635 Sep 09 13:21:58.678172 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 507/1005] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:58 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:58.751975 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-037f31bf-78f2-47fc-9fa4-19da4e30a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:58.752800 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-037f31bf-78f2-47fc-9fa4-19da4e30a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:58.759682 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-037f31bf-78f2-47fc-9fa4-19da4e30a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:58.760229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-037f31bf-78f2-47fc-9fa4-19da4e30a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:58.760665 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-037f31bf-78f2-47fc-9fa4-19da4e30a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:58.761531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-037f31bf-78f2-47fc-9fa4-19da4e30a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:58.762151 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-037f31bf-78f2-47fc-9fa4-19da4e30a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:58.763554 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-037f31bf-78f2-47fc-9fa4-19da4e30a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:58.928675 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-037f31bf-78f2-47fc-9fa4-19da4e30a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:58.937652 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-037f31bf-78f2-47fc-9fa4-19da4e30a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:58.939179 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-037f31bf-78f2-47fc-9fa4-19da4e30a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:58.940566 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-037f31bf-78f2-47fc-9fa4-19da4e30a7dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.194319 Sep 09 13:21:58.941121 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 499/1006] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:58 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:21:59.705398 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-15cb1429-a587-4bc3-8cf1-dc391b7f1eb5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:59.706148 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-15cb1429-a587-4bc3-8cf1-dc391b7f1eb5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:59.712621 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15cb1429-a587-4bc3-8cf1-dc391b7f1eb5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:59.713174 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15cb1429-a587-4bc3-8cf1-dc391b7f1eb5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:59.713676 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15cb1429-a587-4bc3-8cf1-dc391b7f1eb5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:59.714434 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15cb1429-a587-4bc3-8cf1-dc391b7f1eb5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:59.714960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15cb1429-a587-4bc3-8cf1-dc391b7f1eb5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:59.715472 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-15cb1429-a587-4bc3-8cf1-dc391b7f1eb5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:59.944873 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-15cb1429-a587-4bc3-8cf1-dc391b7f1eb5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:21:59.954138 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-15cb1429-a587-4bc3-8cf1-dc391b7f1eb5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1569 microversion: 2.1 time: 0.252704 Sep 09 13:21:59.954708 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 508/1007] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:21:59 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1569 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:21:59.966102 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-eb57b4d4-b107-4755-be0d-b1fe1300a9b7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:21:59.966732 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-eb57b4d4-b107-4755-be0d-b1fe1300a9b7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:21:59.974320 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb57b4d4-b107-4755-be0d-b1fe1300a9b7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:59.974799 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb57b4d4-b107-4755-be0d-b1fe1300a9b7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:59.975278 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb57b4d4-b107-4755-be0d-b1fe1300a9b7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:21:59.975969 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb57b4d4-b107-4755-be0d-b1fe1300a9b7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:21:59.976427 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb57b4d4-b107-4755-be0d-b1fe1300a9b7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:21:59.976863 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-eb57b4d4-b107-4755-be0d-b1fe1300a9b7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:00.154216 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-eb57b4d4-b107-4755-be0d-b1fe1300a9b7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:00.164048 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-eb57b4d4-b107-4755-be0d-b1fe1300a9b7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:00.166234 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-eb57b4d4-b107-4755-be0d-b1fe1300a9b7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:00.167784 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-eb57b4d4-b107-4755-be0d-b1fe1300a9b7 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.205713 Sep 09 13:22:00.179082 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 500/1008] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:21:59 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:22:00.977768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4976ede6-b5c7-499a-8553-8603b11d570b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:00.978366 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4976ede6-b5c7-499a-8553-8603b11d570b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:00.985565 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4976ede6-b5c7-499a-8553-8603b11d570b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:00.986050 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4976ede6-b5c7-499a-8553-8603b11d570b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:00.986487 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4976ede6-b5c7-499a-8553-8603b11d570b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:00.987202 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4976ede6-b5c7-499a-8553-8603b11d570b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:00.987657 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4976ede6-b5c7-499a-8553-8603b11d570b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:00.988079 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4976ede6-b5c7-499a-8553-8603b11d570b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:01.129778 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4976ede6-b5c7-499a-8553-8603b11d570b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:01.138853 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4976ede6-b5c7-499a-8553-8603b11d570b tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1569 microversion: 2.1 time: 0.164901 Sep 09 13:22:01.139513 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 509/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:00 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:01.193602 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c43a0255-cc0e-46f6-aa15-56b881b718b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:01.194223 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c43a0255-cc0e-46f6-aa15-56b881b718b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:01.200779 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c43a0255-cc0e-46f6-aa15-56b881b718b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:01.201542 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c43a0255-cc0e-46f6-aa15-56b881b718b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:01.201993 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c43a0255-cc0e-46f6-aa15-56b881b718b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:01.202708 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c43a0255-cc0e-46f6-aa15-56b881b718b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:01.203188 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c43a0255-cc0e-46f6-aa15-56b881b718b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:01.203621 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c43a0255-cc0e-46f6-aa15-56b881b718b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:01.341459 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c43a0255-cc0e-46f6-aa15-56b881b718b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:01.350183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c43a0255-cc0e-46f6-aa15-56b881b718b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:01.351675 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c43a0255-cc0e-46f6-aa15-56b881b718b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:01.352850 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c43a0255-cc0e-46f6-aa15-56b881b718b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.163105 Sep 09 13:22:01.353409 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 501/1010] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:01 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:02.162087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-644d0861-aa3a-476f-b056-129a64a244b6 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:02.162812 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-644d0861-aa3a-476f-b056-129a64a244b6 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:02.169485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-644d0861-aa3a-476f-b056-129a64a244b6 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:02.170537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-644d0861-aa3a-476f-b056-129a64a244b6 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:02.171124 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-644d0861-aa3a-476f-b056-129a64a244b6 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:02.171833 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-644d0861-aa3a-476f-b056-129a64a244b6 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:02.172290 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-644d0861-aa3a-476f-b056-129a64a244b6 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:02.172716 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-644d0861-aa3a-476f-b056-129a64a244b6 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:02.310113 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-644d0861-aa3a-476f-b056-129a64a244b6 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:02.318902 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-644d0861-aa3a-476f-b056-129a64a244b6 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1569 microversion: 2.1 time: 0.160939 Sep 09 13:22:02.319519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 510/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:02 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:02.379195 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-04395c82-0061-4016-91d5-e1e0ec41abe1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:02.379807 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-04395c82-0061-4016-91d5-e1e0ec41abe1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:02.386091 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04395c82-0061-4016-91d5-e1e0ec41abe1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:02.386571 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04395c82-0061-4016-91d5-e1e0ec41abe1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:02.387002 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04395c82-0061-4016-91d5-e1e0ec41abe1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:02.387804 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04395c82-0061-4016-91d5-e1e0ec41abe1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:02.388258 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04395c82-0061-4016-91d5-e1e0ec41abe1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:02.388746 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-04395c82-0061-4016-91d5-e1e0ec41abe1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:02.521773 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-04395c82-0061-4016-91d5-e1e0ec41abe1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:02.530934 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-04395c82-0061-4016-91d5-e1e0ec41abe1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:02.532413 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-04395c82-0061-4016-91d5-e1e0ec41abe1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:02.533568 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-04395c82-0061-4016-91d5-e1e0ec41abe1 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.158504 Sep 09 13:22:02.534121 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 502/1012] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:02 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:03.342108 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7c9c6eb9-044c-4767-88e4-6bb23441caca tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:03.342851 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7c9c6eb9-044c-4767-88e4-6bb23441caca tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:03.349189 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c9c6eb9-044c-4767-88e4-6bb23441caca tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:03.349674 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c9c6eb9-044c-4767-88e4-6bb23441caca tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:03.350197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c9c6eb9-044c-4767-88e4-6bb23441caca tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:03.350797 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c9c6eb9-044c-4767-88e4-6bb23441caca tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:03.351282 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c9c6eb9-044c-4767-88e4-6bb23441caca tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:03.351702 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7c9c6eb9-044c-4767-88e4-6bb23441caca tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:03.492643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7c9c6eb9-044c-4767-88e4-6bb23441caca tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:03.501398 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7c9c6eb9-044c-4767-88e4-6bb23441caca tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1569 microversion: 2.1 time: 0.163203 Sep 09 13:22:03.501960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 511/1013] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:03 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:03.558537 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c0dbbe77-785f-445b-b103-75d2d7a92821 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:03.559243 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c0dbbe77-785f-445b-b103-75d2d7a92821 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:03.566678 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0dbbe77-785f-445b-b103-75d2d7a92821 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:03.567184 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0dbbe77-785f-445b-b103-75d2d7a92821 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:03.567618 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0dbbe77-785f-445b-b103-75d2d7a92821 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:03.568303 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0dbbe77-785f-445b-b103-75d2d7a92821 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:03.568780 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0dbbe77-785f-445b-b103-75d2d7a92821 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:03.569175 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-c0dbbe77-785f-445b-b103-75d2d7a92821 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:03.704653 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c0dbbe77-785f-445b-b103-75d2d7a92821 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:03.712858 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c0dbbe77-785f-445b-b103-75d2d7a92821 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:03.714482 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c0dbbe77-785f-445b-b103-75d2d7a92821 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:03.715651 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c0dbbe77-785f-445b-b103-75d2d7a92821 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.161167 Sep 09 13:22:03.716312 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 503/1014] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:03 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:04.525015 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-118a080b-c08a-43ac-89fd-e63ca37631a2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:04.525626 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-118a080b-c08a-43ac-89fd-e63ca37631a2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:04.532319 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-118a080b-c08a-43ac-89fd-e63ca37631a2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:04.532809 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-118a080b-c08a-43ac-89fd-e63ca37631a2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:04.533238 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-118a080b-c08a-43ac-89fd-e63ca37631a2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:04.533926 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-118a080b-c08a-43ac-89fd-e63ca37631a2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:04.534562 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-118a080b-c08a-43ac-89fd-e63ca37631a2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:04.534980 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-118a080b-c08a-43ac-89fd-e63ca37631a2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:04.636402 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8c6e749a-b7af-4cfc-8e74-79558a9a2bb2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:04.636893 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8c6e749a-b7af-4cfc-8e74-79558a9a2bb2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:04.643342 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e749a-b7af-4cfc-8e74-79558a9a2bb2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:04.643833 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e749a-b7af-4cfc-8e74-79558a9a2bb2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:04.644274 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e749a-b7af-4cfc-8e74-79558a9a2bb2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:04.644979 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e749a-b7af-4cfc-8e74-79558a9a2bb2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:04.645437 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e749a-b7af-4cfc-8e74-79558a9a2bb2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:04.645865 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8c6e749a-b7af-4cfc-8e74-79558a9a2bb2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:04.669341 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8c6e749a-b7af-4cfc-8e74-79558a9a2bb2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932/ips" status: 200 len: 149 microversion: 2.1 time: 0.036765 Sep 09 13:22:04.673084 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 504/1015] 10.222.0.17 () {58 vars in 1248 bytes} [Fri Sep 9 13:22:04 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:22:04.719245 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-118a080b-c08a-43ac-89fd-e63ca37631a2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:04.728822 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-118a080b-c08a-43ac-89fd-e63ca37631a2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1569 microversion: 2.1 time: 0.207361 Sep 09 13:22:04.730011 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 512/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:04 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:04.751436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2855ea68-7313-454c-8b10-d91ca8299564 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:04.752238 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2855ea68-7313-454c-8b10-d91ca8299564 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:04.758642 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2855ea68-7313-454c-8b10-d91ca8299564 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:04.759155 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2855ea68-7313-454c-8b10-d91ca8299564 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:04.759605 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2855ea68-7313-454c-8b10-d91ca8299564 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:04.760307 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2855ea68-7313-454c-8b10-d91ca8299564 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:04.760767 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2855ea68-7313-454c-8b10-d91ca8299564 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:04.761196 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2855ea68-7313-454c-8b10-d91ca8299564 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:04.970276 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2855ea68-7313-454c-8b10-d91ca8299564 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:04.987227 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2855ea68-7313-454c-8b10-d91ca8299564 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:04.988905 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2855ea68-7313-454c-8b10-d91ca8299564 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:04.990427 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2855ea68-7313-454c-8b10-d91ca8299564 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.244494 Sep 09 13:22:04.992101 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 505/1017] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:04 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:05.754146 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-20f5068e-d8f3-4cf4-9db2-6c01be27ffc1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:05.754765 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-20f5068e-d8f3-4cf4-9db2-6c01be27ffc1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:05.761939 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20f5068e-d8f3-4cf4-9db2-6c01be27ffc1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:05.762619 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20f5068e-d8f3-4cf4-9db2-6c01be27ffc1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:05.763076 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20f5068e-d8f3-4cf4-9db2-6c01be27ffc1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:05.764550 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20f5068e-d8f3-4cf4-9db2-6c01be27ffc1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:05.765036 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20f5068e-d8f3-4cf4-9db2-6c01be27ffc1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:05.765812 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-20f5068e-d8f3-4cf4-9db2-6c01be27ffc1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:05.912939 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-20f5068e-d8f3-4cf4-9db2-6c01be27ffc1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:05.924469 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-20f5068e-d8f3-4cf4-9db2-6c01be27ffc1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1570 microversion: 2.1 time: 0.174102 Sep 09 13:22:05.925032 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 513/1018] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:05 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:05.947981 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3ad0838b-8ce3-4ec2-b980-cb152d4a8499 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:22:05.948580 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3ad0838b-8ce3-4ec2-b980-cb152d4a8499 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:05.954966 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3ad0838b-8ce3-4ec2-b980-cb152d4a8499 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:05.955520 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3ad0838b-8ce3-4ec2-b980-cb152d4a8499 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:05.955942 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3ad0838b-8ce3-4ec2-b980-cb152d4a8499 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:05.956634 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3ad0838b-8ce3-4ec2-b980-cb152d4a8499 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:05.957093 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3ad0838b-8ce3-4ec2-b980-cb152d4a8499 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:05.957709 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3ad0838b-8ce3-4ec2-b980-cb152d4a8499 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:06.023997 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-7fc74d7c-af99-4252-b390-8b321a60bcc0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:06.025149 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-7fc74d7c-af99-4252-b390-8b321a60bcc0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:06.027307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:06.034018 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fc74d7c-af99-4252-b390-8b321a60bcc0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:06.034511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fc74d7c-af99-4252-b390-8b321a60bcc0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:06.035105 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fc74d7c-af99-4252-b390-8b321a60bcc0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:06.035990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fc74d7c-af99-4252-b390-8b321a60bcc0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:06.036599 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fc74d7c-af99-4252-b390-8b321a60bcc0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:06.037347 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-7fc74d7c-af99-4252-b390-8b321a60bcc0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:06.210738 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3ad0838b-8ce3-4ec2-b980-cb152d4a8499 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120623) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 13:22:06.255911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7fc74d7c-af99-4252-b390-8b321a60bcc0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:06.265184 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7fc74d7c-af99-4252-b390-8b321a60bcc0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:06.266642 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-7fc74d7c-af99-4252-b390-8b321a60bcc0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:06.267845 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-7fc74d7c-af99-4252-b390-8b321a60bcc0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.253697 Sep 09 13:22:06.268400 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 514/1019] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:06 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:22:06.274234 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b221d19c-cf6a-4b5a-89db-156ca95a9b16 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f54b863-b849-4899-8201-aa4356015927"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:22:06.276850 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b221d19c-cf6a-4b5a-89db-156ca95a9b16 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:06.286390 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b221d19c-cf6a-4b5a-89db-156ca95a9b16 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:06.287113 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b221d19c-cf6a-4b5a-89db-156ca95a9b16 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:06.287708 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b221d19c-cf6a-4b5a-89db-156ca95a9b16 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:06.288568 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b221d19c-cf6a-4b5a-89db-156ca95a9b16 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:06.289188 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b221d19c-cf6a-4b5a-89db-156ca95a9b16 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:06.289608 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b221d19c-cf6a-4b5a-89db-156ca95a9b16 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:06.312055 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3ad0838b-8ce3-4ec2-b980-cb152d4a8499 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "POST /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b/action" status: 202 len: 0 microversion: 2.1 time: 0.366733 Sep 09 13:22:06.313982 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 506/1020] 10.222.0.17 () {60 vars in 1278 bytes} [Fri Sep 9 13:22:05 2022] POST /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:22:06.325323 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0f6856e5-a553-4b88-95d6-43af36286c89 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:06.325951 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0f6856e5-a553-4b88-95d6-43af36286c89 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:06.337744 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f6856e5-a553-4b88-95d6-43af36286c89 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:06.338426 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f6856e5-a553-4b88-95d6-43af36286c89 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:06.340962 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f6856e5-a553-4b88-95d6-43af36286c89 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:06.341745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f6856e5-a553-4b88-95d6-43af36286c89 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:06.352451 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f6856e5-a553-4b88-95d6-43af36286c89 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:06.354326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0f6856e5-a553-4b88-95d6-43af36286c89 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:06.570211 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0f6856e5-a553-4b88-95d6-43af36286c89 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:06.579571 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0f6856e5-a553-4b88-95d6-43af36286c89 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1518 microversion: 2.1 time: 0.259905 Sep 09 13:22:06.580731 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 507/1021] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:06 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1518 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:06.644372 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:06.658876 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b221d19c-cf6a-4b5a-89db-156ca95a9b16 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "POST /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387873 Sep 09 13:22:06.659698 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 515/1022] 10.222.0.17 () {60 vars in 1323 bytes} [Fri Sep 9 13:22:06 2022] POST /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:22:07.293772 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-41047aba-fa3c-4211-a6e3-1d9d44c1741c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:07.294380 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-41047aba-fa3c-4211-a6e3-1d9d44c1741c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:07.301798 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-41047aba-fa3c-4211-a6e3-1d9d44c1741c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:07.302311 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-41047aba-fa3c-4211-a6e3-1d9d44c1741c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:07.302746 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-41047aba-fa3c-4211-a6e3-1d9d44c1741c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:07.303517 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-41047aba-fa3c-4211-a6e3-1d9d44c1741c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:07.303968 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-41047aba-fa3c-4211-a6e3-1d9d44c1741c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:07.304414 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-41047aba-fa3c-4211-a6e3-1d9d44c1741c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:07.467920 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-41047aba-fa3c-4211-a6e3-1d9d44c1741c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:07.476381 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-41047aba-fa3c-4211-a6e3-1d9d44c1741c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:07.477916 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-41047aba-fa3c-4211-a6e3-1d9d44c1741c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:07.479117 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-41047aba-fa3c-4211-a6e3-1d9d44c1741c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.189316 Sep 09 13:22:07.479675 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 508/1023] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:07 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:07.604360 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4982c5e7-c0cb-4943-972e-867f758a12e2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:07.605207 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4982c5e7-c0cb-4943-972e-867f758a12e2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:07.613148 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4982c5e7-c0cb-4943-972e-867f758a12e2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:07.614071 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4982c5e7-c0cb-4943-972e-867f758a12e2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:07.614071 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4982c5e7-c0cb-4943-972e-867f758a12e2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:07.614769 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4982c5e7-c0cb-4943-972e-867f758a12e2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:07.615279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4982c5e7-c0cb-4943-972e-867f758a12e2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:07.615704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4982c5e7-c0cb-4943-972e-867f758a12e2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:07.761885 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4982c5e7-c0cb-4943-972e-867f758a12e2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:07.770730 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4982c5e7-c0cb-4943-972e-867f758a12e2 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1520 microversion: 2.1 time: 0.170927 Sep 09 13:22:07.771668 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 516/1024] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:07 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:08.505187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-98e4a7b7-560e-487c-92af-ee5a5892dcec tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:08.505797 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-98e4a7b7-560e-487c-92af-ee5a5892dcec tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:08.512531 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98e4a7b7-560e-487c-92af-ee5a5892dcec tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:08.513035 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98e4a7b7-560e-487c-92af-ee5a5892dcec tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:08.513469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98e4a7b7-560e-487c-92af-ee5a5892dcec tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:08.514761 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98e4a7b7-560e-487c-92af-ee5a5892dcec tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:08.515292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98e4a7b7-560e-487c-92af-ee5a5892dcec tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:08.515765 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-98e4a7b7-560e-487c-92af-ee5a5892dcec tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:08.644021 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-98e4a7b7-560e-487c-92af-ee5a5892dcec tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:08.647564 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:08.652952 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-98e4a7b7-560e-487c-92af-ee5a5892dcec tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:08.654451 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-98e4a7b7-560e-487c-92af-ee5a5892dcec tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:08.655642 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-98e4a7b7-560e-487c-92af-ee5a5892dcec tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.154405 Sep 09 13:22:08.656205 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 509/1025] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:08 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:08.808555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bbd648cd-6c7a-428b-a3ff-557ec1286014 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:08.809077 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bbd648cd-6c7a-428b-a3ff-557ec1286014 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:08.816124 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbd648cd-6c7a-428b-a3ff-557ec1286014 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:08.816597 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbd648cd-6c7a-428b-a3ff-557ec1286014 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:08.817021 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbd648cd-6c7a-428b-a3ff-557ec1286014 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:08.817699 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbd648cd-6c7a-428b-a3ff-557ec1286014 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:08.818144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbd648cd-6c7a-428b-a3ff-557ec1286014 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:08.818559 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bbd648cd-6c7a-428b-a3ff-557ec1286014 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:08.957401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bbd648cd-6c7a-428b-a3ff-557ec1286014 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:08.965153 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bbd648cd-6c7a-428b-a3ff-557ec1286014 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1520 microversion: 2.1 time: 0.160529 Sep 09 13:22:08.965722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 517/1026] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:08 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:09.680785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f862a4ce-cc51-4ce1-a77a-b85f4037f9b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:09.681422 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f862a4ce-cc51-4ce1-a77a-b85f4037f9b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:09.689730 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f862a4ce-cc51-4ce1-a77a-b85f4037f9b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:09.690222 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f862a4ce-cc51-4ce1-a77a-b85f4037f9b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:09.690657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f862a4ce-cc51-4ce1-a77a-b85f4037f9b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:09.691384 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f862a4ce-cc51-4ce1-a77a-b85f4037f9b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:09.691840 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f862a4ce-cc51-4ce1-a77a-b85f4037f9b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:09.692269 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f862a4ce-cc51-4ce1-a77a-b85f4037f9b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:09.766978 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0200fa3a-67c1-4e36-9737-b2e28cce3135 req-64f239b3-8116-4875-9ccb-6f241fbe1a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76473280-a8d1-4fed-a202-c9825247c44b", "name": "network-vif-unplugged", "status": "completed", "tag": "48049b9e-9115-47c4-97e1-b44a8a86aef3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:22:09.778247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0200fa3a-67c1-4e36-9737-b2e28cce3135 req-64f239b3-8116-4875-9ccb-6f241fbe1a1f service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:09.778721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0200fa3a-67c1-4e36-9737-b2e28cce3135 req-64f239b3-8116-4875-9ccb-6f241fbe1a1f service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:09.780095 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0200fa3a-67c1-4e36-9737-b2e28cce3135 req-64f239b3-8116-4875-9ccb-6f241fbe1a1f service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:09.791493 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.compute.server_external_events [req-0200fa3a-67c1-4e36-9737-b2e28cce3135 req-64f239b3-8116-4875-9ccb-6f241fbe1a1f service nova] Unable to find a host for instance 76473280-a8d1-4fed-a202-c9825247c44b. Dropping event network-vif-unplugged {{(pid=120625) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 13:22:09.792369 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0200fa3a-67c1-4e36-9737-b2e28cce3135 req-64f239b3-8116-4875-9ccb-6f241fbe1a1f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030007 Sep 09 13:22:09.792950 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 518/1027] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 09 13:22:09.839806 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f862a4ce-cc51-4ce1-a77a-b85f4037f9b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:09.852664 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f862a4ce-cc51-4ce1-a77a-b85f4037f9b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:09.860697 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f862a4ce-cc51-4ce1-a77a-b85f4037f9b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:09.862006 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f862a4ce-cc51-4ce1-a77a-b85f4037f9b9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.185065 Sep 09 13:22:09.862649 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 510/1028] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:09 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:22:09.988023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-33d0575c-cc97-41b0-a993-64f860f2abe9 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:09.988793 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-33d0575c-cc97-41b0-a993-64f860f2abe9 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:09.994742 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d0575c-cc97-41b0-a993-64f860f2abe9 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:09.995264 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d0575c-cc97-41b0-a993-64f860f2abe9 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:09.995699 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d0575c-cc97-41b0-a993-64f860f2abe9 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:09.996388 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d0575c-cc97-41b0-a993-64f860f2abe9 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:09.996843 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d0575c-cc97-41b0-a993-64f860f2abe9 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:09.997273 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-33d0575c-cc97-41b0-a993-64f860f2abe9 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:10.130721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-33d0575c-cc97-41b0-a993-64f860f2abe9 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:10.138390 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-33d0575c-cc97-41b0-a993-64f860f2abe9 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1520 microversion: 2.1 time: 0.154215 Sep 09 13:22:10.139835 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 519/1029] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:09 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:10.887657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-524ef2ed-ae63-4de7-802d-6c78ea9ba0bc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:10.888195 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-524ef2ed-ae63-4de7-802d-6c78ea9ba0bc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:10.894704 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-524ef2ed-ae63-4de7-802d-6c78ea9ba0bc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:10.895219 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-524ef2ed-ae63-4de7-802d-6c78ea9ba0bc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:10.895657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-524ef2ed-ae63-4de7-802d-6c78ea9ba0bc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:10.896344 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-524ef2ed-ae63-4de7-802d-6c78ea9ba0bc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:10.896798 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-524ef2ed-ae63-4de7-802d-6c78ea9ba0bc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:10.897222 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-524ef2ed-ae63-4de7-802d-6c78ea9ba0bc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:11.034192 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-524ef2ed-ae63-4de7-802d-6c78ea9ba0bc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:11.042300 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-524ef2ed-ae63-4de7-802d-6c78ea9ba0bc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:11.043781 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-524ef2ed-ae63-4de7-802d-6c78ea9ba0bc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:11.045766 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-524ef2ed-ae63-4de7-802d-6c78ea9ba0bc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.161281 Sep 09 13:22:11.046339 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 511/1030] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:10 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:11.161864 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-113c6a0d-ce08-4587-a74e-737c88c753a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:11.162405 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-113c6a0d-ce08-4587-a74e-737c88c753a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:11.168823 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-113c6a0d-ce08-4587-a74e-737c88c753a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:11.169306 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-113c6a0d-ce08-4587-a74e-737c88c753a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:11.169741 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-113c6a0d-ce08-4587-a74e-737c88c753a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:11.170649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-113c6a0d-ce08-4587-a74e-737c88c753a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:11.171132 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-113c6a0d-ce08-4587-a74e-737c88c753a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:11.171562 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-113c6a0d-ce08-4587-a74e-737c88c753a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:11.300199 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-113c6a0d-ce08-4587-a74e-737c88c753a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:11.307875 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-113c6a0d-ce08-4587-a74e-737c88c753a8 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1520 microversion: 2.1 time: 0.149935 Sep 09 13:22:11.308441 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 520/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:11 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:12.071333 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f8ec2e13-d2de-42d6-9a7d-1d7f2f7fb092 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:12.071942 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f8ec2e13-d2de-42d6-9a7d-1d7f2f7fb092 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:12.078470 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8ec2e13-d2de-42d6-9a7d-1d7f2f7fb092 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:12.078948 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8ec2e13-d2de-42d6-9a7d-1d7f2f7fb092 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:12.079414 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8ec2e13-d2de-42d6-9a7d-1d7f2f7fb092 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:12.080090 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8ec2e13-d2de-42d6-9a7d-1d7f2f7fb092 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:12.080543 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8ec2e13-d2de-42d6-9a7d-1d7f2f7fb092 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:12.080961 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f8ec2e13-d2de-42d6-9a7d-1d7f2f7fb092 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:12.209363 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f8ec2e13-d2de-42d6-9a7d-1d7f2f7fb092 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:12.217912 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f8ec2e13-d2de-42d6-9a7d-1d7f2f7fb092 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:12.219358 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f8ec2e13-d2de-42d6-9a7d-1d7f2f7fb092 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:12.220508 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f8ec2e13-d2de-42d6-9a7d-1d7f2f7fb092 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.153428 Sep 09 13:22:12.221087 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 512/1032] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:12 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:12.330605 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b22ab8b6-1f51-454f-b098-3c6cac9059d1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:12.331159 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b22ab8b6-1f51-454f-b098-3c6cac9059d1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:12.337437 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b22ab8b6-1f51-454f-b098-3c6cac9059d1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:12.337913 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b22ab8b6-1f51-454f-b098-3c6cac9059d1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:12.338343 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b22ab8b6-1f51-454f-b098-3c6cac9059d1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:12.339020 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b22ab8b6-1f51-454f-b098-3c6cac9059d1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:12.339567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b22ab8b6-1f51-454f-b098-3c6cac9059d1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:12.339986 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b22ab8b6-1f51-454f-b098-3c6cac9059d1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:12.480340 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b22ab8b6-1f51-454f-b098-3c6cac9059d1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:12.489043 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b22ab8b6-1f51-454f-b098-3c6cac9059d1 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1520 microversion: 2.1 time: 0.163099 Sep 09 13:22:12.489621 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 521/1033] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:12 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:13.246164 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-279f10ae-c655-4967-9cff-9c1a4153ee2a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:13.246869 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-279f10ae-c655-4967-9cff-9c1a4153ee2a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:13.254386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-279f10ae-c655-4967-9cff-9c1a4153ee2a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:13.254952 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-279f10ae-c655-4967-9cff-9c1a4153ee2a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:13.255658 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-279f10ae-c655-4967-9cff-9c1a4153ee2a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:13.256637 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-279f10ae-c655-4967-9cff-9c1a4153ee2a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:13.257176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-279f10ae-c655-4967-9cff-9c1a4153ee2a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:13.257676 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-279f10ae-c655-4967-9cff-9c1a4153ee2a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:13.313973 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f3eac03b-45e3-4bd3-9fb7-b4d08395bc57 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:13.314463 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f3eac03b-45e3-4bd3-9fb7-b4d08395bc57 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:13.320458 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3eac03b-45e3-4bd3-9fb7-b4d08395bc57 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:13.321208 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3eac03b-45e3-4bd3-9fb7-b4d08395bc57 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:13.321861 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3eac03b-45e3-4bd3-9fb7-b4d08395bc57 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:13.322739 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3eac03b-45e3-4bd3-9fb7-b4d08395bc57 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:13.323230 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3eac03b-45e3-4bd3-9fb7-b4d08395bc57 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:13.323657 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3eac03b-45e3-4bd3-9fb7-b4d08395bc57 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:13.410863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-f3eac03b-45e3-4bd3-9fb7-b4d08395bc57 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lazy-loading 'services' on Instance uuid 7fff99ec-fa72-4528-9330-ba97ee1ef932 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:22:13.418799 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-279f10ae-c655-4967-9cff-9c1a4153ee2a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:13.427820 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-279f10ae-c655-4967-9cff-9c1a4153ee2a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:13.429666 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-279f10ae-c655-4967-9cff-9c1a4153ee2a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:13.430962 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-279f10ae-c655-4967-9cff-9c1a4153ee2a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1745 microversion: 2.20 time: 0.189133 Sep 09 13:22:13.431559 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 513/1034] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:13 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:13.490621 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f3eac03b-45e3-4bd3-9fb7-b4d08395bc57 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932/os-volume_attachments/0f54b863-b849-4899-8201-aa4356015927" status: 202 len: 0 microversion: 2.1 time: 0.180645 Sep 09 13:22:13.491365 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 522/1035] 10.222.0.17 () {58 vars in 1416 bytes} [Fri Sep 9 13:22:13 2022] DELETE /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932/os-volume_attachments/0f54b863-b849-4899-8201-aa4356015927 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 13:22:13.500972 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d4a03bc7-b706-4a48-9d90-a354fbeda825 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:13.503518 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d4a03bc7-b706-4a48-9d90-a354fbeda825 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:13.510198 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4a03bc7-b706-4a48-9d90-a354fbeda825 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:13.510702 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4a03bc7-b706-4a48-9d90-a354fbeda825 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:13.511170 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4a03bc7-b706-4a48-9d90-a354fbeda825 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:13.511951 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4a03bc7-b706-4a48-9d90-a354fbeda825 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:13.512405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4a03bc7-b706-4a48-9d90-a354fbeda825 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:13.513022 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4a03bc7-b706-4a48-9d90-a354fbeda825 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:13.516961 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-358e4e39-3bca-4a0a-bafd-56c50931bc5e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:13.517743 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-358e4e39-3bca-4a0a-bafd-56c50931bc5e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:13.524336 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-358e4e39-3bca-4a0a-bafd-56c50931bc5e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:13.525111 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-358e4e39-3bca-4a0a-bafd-56c50931bc5e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:13.525753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-358e4e39-3bca-4a0a-bafd-56c50931bc5e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:13.526664 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-358e4e39-3bca-4a0a-bafd-56c50931bc5e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:13.527345 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-358e4e39-3bca-4a0a-bafd-56c50931bc5e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:13.527987 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-358e4e39-3bca-4a0a-bafd-56c50931bc5e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:13.557167 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d4a03bc7-b706-4a48-9d90-a354fbeda825 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061012 Sep 09 13:22:13.558046 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 514/1036] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:22:13 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:22:13.671167 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-358e4e39-3bca-4a0a-bafd-56c50931bc5e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:13.678840 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-358e4e39-3bca-4a0a-bafd-56c50931bc5e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1576 microversion: 2.1 time: 0.166529 Sep 09 13:22:13.679439 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 523/1037] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:13 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:14.457794 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-632bc135-3232-4770-8b3f-506b803bef5a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:14.458412 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-632bc135-3232-4770-8b3f-506b803bef5a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:14.465014 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-632bc135-3232-4770-8b3f-506b803bef5a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:14.465534 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-632bc135-3232-4770-8b3f-506b803bef5a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:14.465967 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-632bc135-3232-4770-8b3f-506b803bef5a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:14.467226 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-632bc135-3232-4770-8b3f-506b803bef5a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:14.467721 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-632bc135-3232-4770-8b3f-506b803bef5a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:14.468159 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-632bc135-3232-4770-8b3f-506b803bef5a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:14.570906 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44078f3c-33a6-44d2-9505-7430f42a0ea2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:14.573782 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-44078f3c-33a6-44d2-9505-7430f42a0ea2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:14.580476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44078f3c-33a6-44d2-9505-7430f42a0ea2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:14.580965 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44078f3c-33a6-44d2-9505-7430f42a0ea2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:14.581400 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44078f3c-33a6-44d2-9505-7430f42a0ea2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:14.582097 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44078f3c-33a6-44d2-9505-7430f42a0ea2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:14.582708 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44078f3c-33a6-44d2-9505-7430f42a0ea2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:14.583195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-44078f3c-33a6-44d2-9505-7430f42a0ea2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:14.599590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-632bc135-3232-4770-8b3f-506b803bef5a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:14.614018 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-632bc135-3232-4770-8b3f-506b803bef5a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:14.615482 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-632bc135-3232-4770-8b3f-506b803bef5a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:14.616742 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-632bc135-3232-4770-8b3f-506b803bef5a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1745 microversion: 2.20 time: 0.162856 Sep 09 13:22:14.617971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 515/1038] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:14 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:22:14.620621 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44078f3c-33a6-44d2-9505-7430f42a0ea2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053620 Sep 09 13:22:14.621178 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 524/1039] 10.222.0.17 () {58 vars in 1302 bytes} [Fri Sep 9 13:22:14 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 13:22:14.685761 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-68d783bc-91ef-438c-adb4-a7c0eb32043c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:14.686258 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-68d783bc-91ef-438c-adb4-a7c0eb32043c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:14.692359 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68d783bc-91ef-438c-adb4-a7c0eb32043c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:14.692843 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68d783bc-91ef-438c-adb4-a7c0eb32043c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:14.693272 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68d783bc-91ef-438c-adb4-a7c0eb32043c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:14.693961 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68d783bc-91ef-438c-adb4-a7c0eb32043c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:14.694411 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68d783bc-91ef-438c-adb4-a7c0eb32043c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:14.694832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-68d783bc-91ef-438c-adb4-a7c0eb32043c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:14.702207 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9103fb37-3273-419a-8604-2f89e934cb72 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:14.703033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9103fb37-3273-419a-8604-2f89e934cb72 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:14.709199 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9103fb37-3273-419a-8604-2f89e934cb72 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:14.709799 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9103fb37-3273-419a-8604-2f89e934cb72 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:14.710331 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9103fb37-3273-419a-8604-2f89e934cb72 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:14.711318 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9103fb37-3273-419a-8604-2f89e934cb72 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:14.711980 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9103fb37-3273-419a-8604-2f89e934cb72 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:14.712402 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9103fb37-3273-419a-8604-2f89e934cb72 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:14.722964 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-68d783bc-91ef-438c-adb4-a7c0eb32043c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:22:14.802079 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-68d783bc-91ef-438c-adb4-a7c0eb32043c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 204 len: 0 microversion: 2.1 time: 0.120080 Sep 09 13:22:14.802812 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 516/1040] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:22:14 2022] DELETE /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:22:14.811218 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-46f9e4e6-2db1-4e12-876e-c668871b6863 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:14.811922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-46f9e4e6-2db1-4e12-876e-c668871b6863 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:14.817737 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46f9e4e6-2db1-4e12-876e-c668871b6863 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:14.818232 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46f9e4e6-2db1-4e12-876e-c668871b6863 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:14.818671 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46f9e4e6-2db1-4e12-876e-c668871b6863 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:14.819401 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46f9e4e6-2db1-4e12-876e-c668871b6863 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:14.819857 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46f9e4e6-2db1-4e12-876e-c668871b6863 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:14.820293 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-46f9e4e6-2db1-4e12-876e-c668871b6863 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:14.852050 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9103fb37-3273-419a-8604-2f89e934cb72 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:14.860875 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9103fb37-3273-419a-8604-2f89e934cb72 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1576 microversion: 2.1 time: 0.163068 Sep 09 13:22:14.861448 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 525/1041] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:14 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:22:14.949953 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-46f9e4e6-2db1-4e12-876e-c668871b6863 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:14.958263 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-46f9e4e6-2db1-4e12-876e-c668871b6863 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1681 microversion: 2.1 time: 0.151227 Sep 09 13:22:14.959009 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 517/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:14 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:22:15.644335 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c69f8855-ccf9-4c54-afd4-1ef6a31be7aa tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:15.644941 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c69f8855-ccf9-4c54-afd4-1ef6a31be7aa tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:15.651450 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c69f8855-ccf9-4c54-afd4-1ef6a31be7aa tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:15.651930 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c69f8855-ccf9-4c54-afd4-1ef6a31be7aa tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:15.652358 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c69f8855-ccf9-4c54-afd4-1ef6a31be7aa tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:15.653044 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c69f8855-ccf9-4c54-afd4-1ef6a31be7aa tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:15.653489 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c69f8855-ccf9-4c54-afd4-1ef6a31be7aa tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:15.654325 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c69f8855-ccf9-4c54-afd4-1ef6a31be7aa tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:15.789587 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c69f8855-ccf9-4c54-afd4-1ef6a31be7aa tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:15.798079 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c69f8855-ccf9-4c54-afd4-1ef6a31be7aa tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:15.799649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c69f8855-ccf9-4c54-afd4-1ef6a31be7aa tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:15.800886 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c69f8855-ccf9-4c54-afd4-1ef6a31be7aa tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1745 microversion: 2.20 time: 0.160551 Sep 09 13:22:15.801447 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 526/1043] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:15 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:22:15.884287 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0198a5ec-ce06-40e0-bdff-d040dcfec8e5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:15.884910 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0198a5ec-ce06-40e0-bdff-d040dcfec8e5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:15.886893 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:15.893829 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0198a5ec-ce06-40e0-bdff-d040dcfec8e5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:15.894418 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0198a5ec-ce06-40e0-bdff-d040dcfec8e5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:15.894951 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0198a5ec-ce06-40e0-bdff-d040dcfec8e5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:15.895718 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0198a5ec-ce06-40e0-bdff-d040dcfec8e5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:15.896231 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0198a5ec-ce06-40e0-bdff-d040dcfec8e5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:15.896677 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-0198a5ec-ce06-40e0-bdff-d040dcfec8e5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:15.981978 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e06e38d2-630f-481e-ac4d-47c3365ab2e2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:15.982593 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e06e38d2-630f-481e-ac4d-47c3365ab2e2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:15.989479 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e06e38d2-630f-481e-ac4d-47c3365ab2e2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:15.989968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e06e38d2-630f-481e-ac4d-47c3365ab2e2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:15.990401 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e06e38d2-630f-481e-ac4d-47c3365ab2e2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:15.991132 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e06e38d2-630f-481e-ac4d-47c3365ab2e2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:15.991581 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e06e38d2-630f-481e-ac4d-47c3365ab2e2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:15.992212 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e06e38d2-630f-481e-ac4d-47c3365ab2e2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:16.043556 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0198a5ec-ce06-40e0-bdff-d040dcfec8e5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:16.052910 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0198a5ec-ce06-40e0-bdff-d040dcfec8e5 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1576 microversion: 2.1 time: 0.172579 Sep 09 13:22:16.053719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 518/1044] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:15 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:16.132173 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e06e38d2-630f-481e-ac4d-47c3365ab2e2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:16.139770 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e06e38d2-630f-481e-ac4d-47c3365ab2e2 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1681 microversion: 2.1 time: 0.161644 Sep 09 13:22:16.140956 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 527/1045] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:15 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:22:16.825764 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-45e802a7-fc1c-46b3-bcc0-28baf8fde30b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:16.826376 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-45e802a7-fc1c-46b3-bcc0-28baf8fde30b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:16.832518 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-45e802a7-fc1c-46b3-bcc0-28baf8fde30b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:16.832997 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-45e802a7-fc1c-46b3-bcc0-28baf8fde30b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:16.833429 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-45e802a7-fc1c-46b3-bcc0-28baf8fde30b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:16.834116 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-45e802a7-fc1c-46b3-bcc0-28baf8fde30b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:16.834594 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-45e802a7-fc1c-46b3-bcc0-28baf8fde30b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:16.834997 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-45e802a7-fc1c-46b3-bcc0-28baf8fde30b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:16.965991 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-45e802a7-fc1c-46b3-bcc0-28baf8fde30b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:16.974750 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-45e802a7-fc1c-46b3-bcc0-28baf8fde30b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:16.976222 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-45e802a7-fc1c-46b3-bcc0-28baf8fde30b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:16.977374 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-45e802a7-fc1c-46b3-bcc0-28baf8fde30b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1740 microversion: 2.20 time: 0.155552 Sep 09 13:22:16.977928 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 519/1046] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:16 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:17.077265 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e3e1922f-be36-4682-b819-7c82663db33f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:17.077870 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e3e1922f-be36-4682-b819-7c82663db33f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:17.085633 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e1922f-be36-4682-b819-7c82663db33f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:17.087225 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e1922f-be36-4682-b819-7c82663db33f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:17.087678 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e1922f-be36-4682-b819-7c82663db33f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:17.088832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e1922f-be36-4682-b819-7c82663db33f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:17.090686 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e1922f-be36-4682-b819-7c82663db33f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:17.091172 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e3e1922f-be36-4682-b819-7c82663db33f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:17.163849 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-79e40a84-0934-4306-b9ec-3a04bc55ece3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:17.164739 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-79e40a84-0934-4306-b9ec-3a04bc55ece3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:17.171340 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79e40a84-0934-4306-b9ec-3a04bc55ece3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:17.172795 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79e40a84-0934-4306-b9ec-3a04bc55ece3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:17.173314 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79e40a84-0934-4306-b9ec-3a04bc55ece3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:17.174126 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79e40a84-0934-4306-b9ec-3a04bc55ece3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:17.174944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79e40a84-0934-4306-b9ec-3a04bc55ece3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:17.175848 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-79e40a84-0934-4306-b9ec-3a04bc55ece3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:17.340189 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e3e1922f-be36-4682-b819-7c82663db33f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:17.341756 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-79e40a84-0934-4306-b9ec-3a04bc55ece3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:17.350808 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-79e40a84-0934-4306-b9ec-3a04bc55ece3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1681 microversion: 2.1 time: 0.190963 Sep 09 13:22:17.351569 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 520/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:17 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:22:17.352288 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e3e1922f-be36-4682-b819-7c82663db33f tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1576 microversion: 2.1 time: 0.279335 Sep 09 13:22:17.367475 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 528/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:17 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1576 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:17.865709 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-f14acaee-dc36-4876-83c8-71713ec2643d req-81758c9f-b6b1-447a-a311-fcc1174fe77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bed376-e738-4913-8eea-71014b54ed1f", "name": "network-vif-plugged", "status": "completed", "tag": "38c754fd-a2fb-4031-a376-b82c80b97094"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:22:17.884123 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-f14acaee-dc36-4876-83c8-71713ec2643d req-81758c9f-b6b1-447a-a311-fcc1174fe77c service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:17.884879 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-f14acaee-dc36-4876-83c8-71713ec2643d req-81758c9f-b6b1-447a-a311-fcc1174fe77c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:17.887333 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-f14acaee-dc36-4876-83c8-71713ec2643d req-81758c9f-b6b1-447a-a311-fcc1174fe77c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:17.904949 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-f14acaee-dc36-4876-83c8-71713ec2643d req-81758c9f-b6b1-447a-a311-fcc1174fe77c service nova] Creating event network-vif-plugged:38c754fd-a2fb-4031-a376-b82c80b97094 for instance b2bed376-e738-4913-8eea-71014b54ed1f on hv-cinder-83124 Sep 09 13:22:17.913898 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-f14acaee-dc36-4876-83c8-71713ec2643d req-81758c9f-b6b1-447a-a311-fcc1174fe77c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054125 Sep 09 13:22:17.915129 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 521/1049] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:22:18.004990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-fafc5323-7a33-484c-9497-94cfd8488482 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:18.005732 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-fafc5323-7a33-484c-9497-94cfd8488482 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:18.012119 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fafc5323-7a33-484c-9497-94cfd8488482 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:18.012916 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fafc5323-7a33-484c-9497-94cfd8488482 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:18.013735 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fafc5323-7a33-484c-9497-94cfd8488482 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:18.014675 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fafc5323-7a33-484c-9497-94cfd8488482 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:18.015944 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fafc5323-7a33-484c-9497-94cfd8488482 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:18.018085 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-fafc5323-7a33-484c-9497-94cfd8488482 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:18.184744 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-3f03e5dd-fa37-4f6a-aa99-bf7d23e09e5b req-9b2a17ee-fd1e-4fb6-8757-dd7b4abb1287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fff99ec-fa72-4528-9330-ba97ee1ef932", "name": "network-vif-deleted", "tag": "dd1a9f57-a793-4888-912b-f664f644cf55"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:22:18.233572 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-3f03e5dd-fa37-4f6a-aa99-bf7d23e09e5b req-9b2a17ee-fd1e-4fb6-8757-dd7b4abb1287 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:18.236362 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-3f03e5dd-fa37-4f6a-aa99-bf7d23e09e5b req-9b2a17ee-fd1e-4fb6-8757-dd7b4abb1287 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:18.237135 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-3f03e5dd-fa37-4f6a-aa99-bf7d23e09e5b req-9b2a17ee-fd1e-4fb6-8757-dd7b4abb1287 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:18.290641 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-3f03e5dd-fa37-4f6a-aa99-bf7d23e09e5b req-9b2a17ee-fd1e-4fb6-8757-dd7b4abb1287 service nova] Creating event network-vif-deleted:dd1a9f57-a793-4888-912b-f664f644cf55 for instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 on hv-cinder-83124 Sep 09 13:22:18.307648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-3f03e5dd-fa37-4f6a-aa99-bf7d23e09e5b req-9b2a17ee-fd1e-4fb6-8757-dd7b4abb1287 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130713 Sep 09 13:22:18.309214 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 522/1050] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:22:18.383385 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-80752966-3f83-489c-90d1-231961581a60 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:18.384721 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-80752966-3f83-489c-90d1-231961581a60 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:18.421664 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80752966-3f83-489c-90d1-231961581a60 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:18.422711 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80752966-3f83-489c-90d1-231961581a60 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:18.424453 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80752966-3f83-489c-90d1-231961581a60 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:18.427144 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80752966-3f83-489c-90d1-231961581a60 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:18.431526 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80752966-3f83-489c-90d1-231961581a60 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:18.435572 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80752966-3f83-489c-90d1-231961581a60 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:18.535811 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80752966-3f83-489c-90d1-231961581a60 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:18.537168 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80752966-3f83-489c-90d1-231961581a60 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:18.540271 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-80752966-3f83-489c-90d1-231961581a60 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:18.540869 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-80752966-3f83-489c-90d1-231961581a60 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lazy-loading 'fault' on Instance uuid 7fff99ec-fa72-4528-9330-ba97ee1ef932 {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:22:18.635121 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-80752966-3f83-489c-90d1-231961581a60 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb88983a8e1439588644b71170d7362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b24b42ca93941aa8e70f5fa10303f4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:18.650670 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-80752966-3f83-489c-90d1-231961581a60 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 200 len: 1331 microversion: 2.1 time: 0.268856 Sep 09 13:22:18.655347 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 523/1051] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:18 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 1331 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:18.667788 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d259ccb8-ae84-4b3e-ab0c-dba12f73823e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:18.668777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d259ccb8-ae84-4b3e-ab0c-dba12f73823e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:18.675583 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d259ccb8-ae84-4b3e-ab0c-dba12f73823e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:18.676569 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d259ccb8-ae84-4b3e-ab0c-dba12f73823e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:18.677617 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d259ccb8-ae84-4b3e-ab0c-dba12f73823e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:18.678639 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d259ccb8-ae84-4b3e-ab0c-dba12f73823e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:18.679549 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d259ccb8-ae84-4b3e-ab0c-dba12f73823e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:18.680202 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d259ccb8-ae84-4b3e-ab0c-dba12f73823e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:18.694490 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fafc5323-7a33-484c-9497-94cfd8488482 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:18.711981 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fafc5323-7a33-484c-9497-94cfd8488482 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:18.714581 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-fafc5323-7a33-484c-9497-94cfd8488482 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:18.716693 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-fafc5323-7a33-484c-9497-94cfd8488482 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1740 microversion: 2.20 time: 0.716164 Sep 09 13:22:18.717926 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 529/1052] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:17 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1740 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:18.891224 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d259ccb8-ae84-4b3e-ab0c-dba12f73823e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:18.900764 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d259ccb8-ae84-4b3e-ab0c-dba12f73823e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1576 microversion: 2.1 time: 0.242869 Sep 09 13:22:18.901540 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 524/1053] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:18 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1576 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:19.678307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f690c483-c717-4ca6-ad34-4e25bcb4e945 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:19.679183 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f690c483-c717-4ca6-ad34-4e25bcb4e945 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:19.688530 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f690c483-c717-4ca6-ad34-4e25bcb4e945 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:19.692417 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f690c483-c717-4ca6-ad34-4e25bcb4e945 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:19.693172 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f690c483-c717-4ca6-ad34-4e25bcb4e945 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:19.694146 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f690c483-c717-4ca6-ad34-4e25bcb4e945 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:19.696235 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f690c483-c717-4ca6-ad34-4e25bcb4e945 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:19.696801 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f690c483-c717-4ca6-ad34-4e25bcb4e945 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:19.725027 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-f690c483-c717-4ca6-ad34-4e25bcb4e945 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] HTTP exception thrown: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f690c483-c717-4ca6-ad34-4e25bcb4e945 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Request method failure captured: Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 HTTP/1.1 Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzxOEkSw_D0B2DWW3aDp6JHSyeYSFkFADbNPgrw4so5mlP-Ugc06W6Rkqydb-b3AAsVzR7p1RzJdXA1668TSyot_sK8AkXdZkK5Jg9C97nHfO5kDuLQSdUnou_VoOzEQjYwBo46vUgiPeKNiJ0QlKMZ9JN2CFXzSZOPwjJ0bmZDR7mw Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:22:19.727150 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:22:19.728937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6b24b42ca93941aa8e70f5fa10303f4d", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:22:19.728937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:19.728937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:19.728937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:19.728937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:19.728937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:22:19.728937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:22:19.728937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: dcb88983a8e1439588644b71170d7362 Sep 09 13:22:19.728937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:19.728937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:22:19.728937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:19.728937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '7fff99ec-fa72-4528-9330-ba97ee1ef932'} Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:22:19.729924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:19.731344 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:19.733825 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f690c483-c717-4ca6-ad34-4e25bcb4e945 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Returning 404 to user: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:22:19.735729 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f690c483-c717-4ca6-ad34-4e25bcb4e945 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 404 len: 111 microversion: 2.1 time: 0.061799 Sep 09 13:22:19.736836 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 530/1054] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:19 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:22:19.745722 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-84ab4c92-3f50-4328-8cdd-377593e25801 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '.version_select at 0x7fd4a190d8b0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:19.759194 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d61b2f07-d7fd-49a5-b650-14bc392f4231 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:19.759846 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d61b2f07-d7fd-49a5-b650-14bc392f4231 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:19.768311 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d61b2f07-d7fd-49a5-b650-14bc392f4231 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:19.768723 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-84ab4c92-3f50-4328-8cdd-377593e25801 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-390683967" status: 202 len: 0 microversion: 2.1 time: 0.026965 Sep 09 13:22:19.768886 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d61b2f07-d7fd-49a5-b650-14bc392f4231 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:19.770075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d61b2f07-d7fd-49a5-b650-14bc392f4231 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:19.770996 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d61b2f07-d7fd-49a5-b650-14bc392f4231 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:19.772127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d61b2f07-d7fd-49a5-b650-14bc392f4231 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:19.772722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d61b2f07-d7fd-49a5-b650-14bc392f4231 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:19.773789 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 525/1055] 10.222.0.17 () {58 vars in 1218 bytes} [Fri Sep 9 13:22:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-390683967 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:22:19.925695 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-3fb8a537-47f9-4c55-afee-7de362156016 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:19.926631 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-3fb8a537-47f9-4c55-afee-7de362156016 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:19.940611 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fb8a537-47f9-4c55-afee-7de362156016 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:19.941533 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fb8a537-47f9-4c55-afee-7de362156016 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:19.942201 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fb8a537-47f9-4c55-afee-7de362156016 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:19.943181 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fb8a537-47f9-4c55-afee-7de362156016 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:19.943874 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fb8a537-47f9-4c55-afee-7de362156016 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:19.944513 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-3fb8a537-47f9-4c55-afee-7de362156016 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:20.018613 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d61b2f07-d7fd-49a5-b650-14bc392f4231 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:20.032772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d61b2f07-d7fd-49a5-b650-14bc392f4231 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:20.034244 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d61b2f07-d7fd-49a5-b650-14bc392f4231 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:20.035458 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d61b2f07-d7fd-49a5-b650-14bc392f4231 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1740 microversion: 2.20 time: 0.282812 Sep 09 13:22:20.057625 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 531/1056] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:19 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:20.155659 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-3fb8a537-47f9-4c55-afee-7de362156016 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:20.160221 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:20.169688 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-3fb8a537-47f9-4c55-afee-7de362156016 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1576 microversion: 2.1 time: 0.248245 Sep 09 13:22:20.170910 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 526/1057] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:19 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1576 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:22:21.072013 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9d06ff61-c9a0-461c-8ffb-51bd4086c9ff tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:21.073370 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9d06ff61-c9a0-461c-8ffb-51bd4086c9ff tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:21.082387 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d06ff61-c9a0-461c-8ffb-51bd4086c9ff tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:21.083291 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d06ff61-c9a0-461c-8ffb-51bd4086c9ff tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:21.083791 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d06ff61-c9a0-461c-8ffb-51bd4086c9ff tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:21.084663 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d06ff61-c9a0-461c-8ffb-51bd4086c9ff tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:21.085112 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d06ff61-c9a0-461c-8ffb-51bd4086c9ff tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:21.085707 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9d06ff61-c9a0-461c-8ffb-51bd4086c9ff tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:21.196367 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a1b868a5-b9c6-47c6-9709-034c2e541473 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:21.197615 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a1b868a5-b9c6-47c6-9709-034c2e541473 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:21.207802 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1b868a5-b9c6-47c6-9709-034c2e541473 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:21.208864 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1b868a5-b9c6-47c6-9709-034c2e541473 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:21.209307 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1b868a5-b9c6-47c6-9709-034c2e541473 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:21.210022 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1b868a5-b9c6-47c6-9709-034c2e541473 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:21.210475 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1b868a5-b9c6-47c6-9709-034c2e541473 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:21.210916 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a1b868a5-b9c6-47c6-9709-034c2e541473 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:21.268608 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9d06ff61-c9a0-461c-8ffb-51bd4086c9ff tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:21.281242 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9d06ff61-c9a0-461c-8ffb-51bd4086c9ff tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:21.282977 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9d06ff61-c9a0-461c-8ffb-51bd4086c9ff tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:21.285002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9d06ff61-c9a0-461c-8ffb-51bd4086c9ff tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1740 microversion: 2.20 time: 0.217012 Sep 09 13:22:21.287889 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 532/1058] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:21 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:21.367465 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a1b868a5-b9c6-47c6-9709-034c2e541473 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:21.376870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a1b868a5-b9c6-47c6-9709-034c2e541473 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1576 microversion: 2.1 time: 0.184994 Sep 09 13:22:21.377741 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 527/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:21 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:22:21.877540 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-8e1f950b-37e9-4f4c-9af9-1787652262b0 req-9ca1b219-76cb-4fef-8ef8-c3a8643ea2d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76473280-a8d1-4fed-a202-c9825247c44b", "name": "network-vif-plugged", "status": "completed", "tag": "48049b9e-9115-47c4-97e1-b44a8a86aef3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:22:21.884450 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bc60186b-2347-4c05-8a2f-93dffbc58f33 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:21.884914 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bc60186b-2347-4c05-8a2f-93dffbc58f33 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:21.895405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc60186b-2347-4c05-8a2f-93dffbc58f33 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:21.895405 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc60186b-2347-4c05-8a2f-93dffbc58f33 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:21.896391 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc60186b-2347-4c05-8a2f-93dffbc58f33 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:21.896585 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc60186b-2347-4c05-8a2f-93dffbc58f33 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:21.897017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc60186b-2347-4c05-8a2f-93dffbc58f33 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:21.897669 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bc60186b-2347-4c05-8a2f-93dffbc58f33 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:21.903843 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8e1f950b-37e9-4f4c-9af9-1787652262b0 req-9ca1b219-76cb-4fef-8ef8-c3a8643ea2d2 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:21.904347 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8e1f950b-37e9-4f4c-9af9-1787652262b0 req-9ca1b219-76cb-4fef-8ef8-c3a8643ea2d2 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:21.904851 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-8e1f950b-37e9-4f4c-9af9-1787652262b0 req-9ca1b219-76cb-4fef-8ef8-c3a8643ea2d2 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:21.910031 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:21.918804 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-bc60186b-2347-4c05-8a2f-93dffbc58f33 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] HTTP exception thrown: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:21.919410 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-8e1f950b-37e9-4f4c-9af9-1787652262b0 req-9ca1b219-76cb-4fef-8ef8-c3a8643ea2d2 service nova] Creating event network-vif-plugged:48049b9e-9115-47c4-97e1-b44a8a86aef3 for instance 76473280-a8d1-4fed-a202-c9825247c44b on hv-cinder-83124 Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bc60186b-2347-4c05-8a2f-93dffbc58f33 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Request method failure captured: Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: DELETE /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 HTTP/1.1 Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxOEkSw_D0B2DWW3aDp6JHSyeYSFkFADbNPgrw4so5mlP-Ugc06W6Rkqydb-b3AAsVzR7p1RzJdXA1668TSyot_sK8AkXdZkK5Jg9C97nHfO5kDuLQSdUnou_VoOzEQjYwBo46vUgiPeKNiJ0QlKMZ9JN2CFXzSZOPwjJ0bmZDR7mw Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:22:21.921030 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:22:21.923386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6b24b42ca93941aa8e70f5fa10303f4d", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:22:21.923386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:21.923386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:21.923386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:21.923386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:21.923386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:22:21.923386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:22:21.923386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: dcb88983a8e1439588644b71170d7362 Sep 09 13:22:21.923386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:21.923386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:22:21.923386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:21.923386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '7fff99ec-fa72-4528-9330-ba97ee1ef932'} Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:22:21.924326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:21.925932 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:21.927537 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bc60186b-2347-4c05-8a2f-93dffbc58f33 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Returning 404 to user: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:22:21.930737 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bc60186b-2347-4c05-8a2f-93dffbc58f33 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 404 len: 111 microversion: 2.1 time: 0.049254 Sep 09 13:22:21.931942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-8e1f950b-37e9-4f4c-9af9-1787652262b0 req-9ca1b219-76cb-4fef-8ef8-c3a8643ea2d2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059091 Sep 09 13:22:21.932735 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 533/1060] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:22:21.936249 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 528/1061] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:22:21 2022] DELETE /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 13:22:21.943089 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-31f54004-0d9b-4125-a72c-3058858d4afd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:21.944003 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-31f54004-0d9b-4125-a72c-3058858d4afd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 7fff99ec-fa72-4528-9330-ba97ee1ef932] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:21.952459 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31f54004-0d9b-4125-a72c-3058858d4afd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:21.953718 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31f54004-0d9b-4125-a72c-3058858d4afd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:21.954635 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31f54004-0d9b-4125-a72c-3058858d4afd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:21.956382 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31f54004-0d9b-4125-a72c-3058858d4afd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:21.957188 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31f54004-0d9b-4125-a72c-3058858d4afd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:21.957830 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-31f54004-0d9b-4125-a72c-3058858d4afd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:21.976665 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-31f54004-0d9b-4125-a72c-3058858d4afd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] HTTP exception thrown: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-31f54004-0d9b-4125-a72c-3058858d4afd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Request method failure captured: Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 HTTP/1.1 Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzxOEkSw_D0B2DWW3aDp6JHSyeYSFkFADbNPgrw4so5mlP-Ugc06W6Rkqydb-b3AAsVzR7p1RzJdXA1668TSyot_sK8AkXdZkK5Jg9C97nHfO5kDuLQSdUnou_VoOzEQjYwBo46vUgiPeKNiJ0QlKMZ9JN2CFXzSZOPwjJ0bmZDR7mw Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:22:21.978714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:22:21.980456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6b24b42ca93941aa8e70f5fa10303f4d", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:22:21.980456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:21.980456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:21.980456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:21.980456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:21.980456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:22:21.980456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:22:21.980456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: dcb88983a8e1439588644b71170d7362 Sep 09 13:22:21.980456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:21.980456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:22:21.980456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:21.980456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '7fff99ec-fa72-4528-9330-ba97ee1ef932'} Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:22:21.981446 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. Sep 09 13:22:21.982722 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:21.985841 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-31f54004-0d9b-4125-a72c-3058858d4afd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Returning 404 to user: Instance 7fff99ec-fa72-4528-9330-ba97ee1ef932 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:22:21.985841 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-31f54004-0d9b-4125-a72c-3058858d4afd tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932" status: 404 len: 111 microversion: 2.1 time: 0.048746 Sep 09 13:22:21.990697 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 534/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:21 2022] GET /compute/v2.1/servers/7fff99ec-fa72-4528-9330-ba97ee1ef932 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 13:22:22.320417 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1829d8c0-a193-44bf-a45b-11eb67661686 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:22.321517 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1829d8c0-a193-44bf-a45b-11eb67661686 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:22.330124 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1829d8c0-a193-44bf-a45b-11eb67661686 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:22.330888 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1829d8c0-a193-44bf-a45b-11eb67661686 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:22.331523 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1829d8c0-a193-44bf-a45b-11eb67661686 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:22.332239 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1829d8c0-a193-44bf-a45b-11eb67661686 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:22.332698 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1829d8c0-a193-44bf-a45b-11eb67661686 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:22.333127 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1829d8c0-a193-44bf-a45b-11eb67661686 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:22.406747 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f98a1e0-137a-4483-9bdf-7fa9fd308963 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:22.408359 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9f98a1e0-137a-4483-9bdf-7fa9fd308963 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:22.415101 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f98a1e0-137a-4483-9bdf-7fa9fd308963 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:22.415806 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f98a1e0-137a-4483-9bdf-7fa9fd308963 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:22.416450 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f98a1e0-137a-4483-9bdf-7fa9fd308963 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:22.417368 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f98a1e0-137a-4483-9bdf-7fa9fd308963 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:22.418022 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f98a1e0-137a-4483-9bdf-7fa9fd308963 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:22.418704 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f98a1e0-137a-4483-9bdf-7fa9fd308963 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:22.530376 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1829d8c0-a193-44bf-a45b-11eb67661686 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:22.538801 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1829d8c0-a193-44bf-a45b-11eb67661686 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:22.540802 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1829d8c0-a193-44bf-a45b-11eb67661686 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:22.542044 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1829d8c0-a193-44bf-a45b-11eb67661686 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1740 microversion: 2.20 time: 0.229668 Sep 09 13:22:22.542620 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 529/1063] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:22 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:22:22.594829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9f98a1e0-137a-4483-9bdf-7fa9fd308963 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:22.608188 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f98a1e0-137a-4483-9bdf-7fa9fd308963 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1576 microversion: 2.1 time: 0.206498 Sep 09 13:22:22.620118 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 535/1064] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:22 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1576 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:22:23.190358 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fcb383c2-ca3f-4c9b-968e-a8d27a4f55e7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:23.191308 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fcb383c2-ca3f-4c9b-968e-a8d27a4f55e7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:23.197404 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fcb383c2-ca3f-4c9b-968e-a8d27a4f55e7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:23.197897 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fcb383c2-ca3f-4c9b-968e-a8d27a4f55e7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:23.198333 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fcb383c2-ca3f-4c9b-968e-a8d27a4f55e7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:23.199033 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fcb383c2-ca3f-4c9b-968e-a8d27a4f55e7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:23.199593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fcb383c2-ca3f-4c9b-968e-a8d27a4f55e7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:23.199919 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fcb383c2-ca3f-4c9b-968e-a8d27a4f55e7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:23.215724 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-fcb383c2-ca3f-4c9b-968e-a8d27a4f55e7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] HTTP exception thrown: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fcb383c2-ca3f-4c9b-968e-a8d27a4f55e7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Request method failure captured: Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: DELETE /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 HTTP/1.1 Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxOEkSw_D0B2DWW3aDp6JHSyeYSFkFADbNPgrw4so5mlP-Ugc06W6Rkqydb-b3AAsVzR7p1RzJdXA1668TSyot_sK8AkXdZkK5Jg9C97nHfO5kDuLQSdUnou_VoOzEQjYwBo46vUgiPeKNiJ0QlKMZ9JN2CFXzSZOPwjJ0bmZDR7mw Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:22:23.217313 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:22:23.218838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6b24b42ca93941aa8e70f5fa10303f4d", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:22:23.218838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:23.218838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:23.218838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:23.218838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:23.218838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:22:23.218838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:22:23.218838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: dcb88983a8e1439588644b71170d7362 Sep 09 13:22:23.218838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:23.218838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:22:23.218838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:22:23.218838 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '68162eb9-cbe5-401b-bd53-8a1a715bb164'} Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:22:23.220187 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:22:23.221903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.223227 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fcb383c2-ca3f-4c9b-968e-a8d27a4f55e7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Returning 404 to user: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:22:23.223227 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fcb383c2-ca3f-4c9b-968e-a8d27a4f55e7 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 404 len: 111 microversion: 2.1 time: 0.034069 Sep 09 13:22:23.223227 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 530/1065] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:22:23 2022] DELETE /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:22:23.229510 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ec1be97-c014-4e57-8163-f2ac057f95cc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:23.230353 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-2ec1be97-c014-4e57-8163-f2ac057f95cc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 68162eb9-cbe5-401b-bd53-8a1a715bb164] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:23.237192 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ec1be97-c014-4e57-8163-f2ac057f95cc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:23.237677 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ec1be97-c014-4e57-8163-f2ac057f95cc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:23.238301 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ec1be97-c014-4e57-8163-f2ac057f95cc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:23.239009 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ec1be97-c014-4e57-8163-f2ac057f95cc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:23.239503 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ec1be97-c014-4e57-8163-f2ac057f95cc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:23.239924 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-2ec1be97-c014-4e57-8163-f2ac057f95cc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:23.254877 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-2ec1be97-c014-4e57-8163-f2ac057f95cc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] HTTP exception thrown: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ec1be97-c014-4e57-8163-f2ac057f95cc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Request method failure captured: Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 HTTP/1.1 Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzxOEkSw_D0B2DWW3aDp6JHSyeYSFkFADbNPgrw4so5mlP-Ugc06W6Rkqydb-b3AAsVzR7p1RzJdXA1668TSyot_sK8AkXdZkK5Jg9C97nHfO5kDuLQSdUnou_VoOzEQjYwBo46vUgiPeKNiJ0QlKMZ9JN2CFXzSZOPwjJ0bmZDR7mw Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:22:23.256594 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:22:23.257990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6b24b42ca93941aa8e70f5fa10303f4d", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:22:23.257990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:23.257990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:23.257990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:23.257990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:23.257990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:22:23.257990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:22:23.257990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: dcb88983a8e1439588644b71170d7362 Sep 09 13:22:23.257990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:23.257990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:22:23.257990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:22:23.257990 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '68162eb9-cbe5-401b-bd53-8a1a715bb164'} Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:22:23.261911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. Sep 09 13:22:23.263810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.264988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-2ec1be97-c014-4e57-8163-f2ac057f95cc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Returning 404 to user: Instance 68162eb9-cbe5-401b-bd53-8a1a715bb164 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:22:23.264988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-2ec1be97-c014-4e57-8163-f2ac057f95cc tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164" status: 404 len: 111 microversion: 2.1 time: 0.032465 Sep 09 13:22:23.264988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 536/1066] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:23 2022] GET /compute/v2.1/servers/68162eb9-cbe5-401b-bd53-8a1a715bb164 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:22:23.267883 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e37ab7d3-1863-4233-b925-345faecd00d6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:23.268351 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-e37ab7d3-1863-4233-b925-345faecd00d6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:23.275553 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e37ab7d3-1863-4233-b925-345faecd00d6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:23.276046 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e37ab7d3-1863-4233-b925-345faecd00d6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:23.276481 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e37ab7d3-1863-4233-b925-345faecd00d6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:23.277198 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e37ab7d3-1863-4233-b925-345faecd00d6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:23.277777 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e37ab7d3-1863-4233-b925-345faecd00d6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:23.278198 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-e37ab7d3-1863-4233-b925-345faecd00d6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:23.293676 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-e37ab7d3-1863-4233-b925-345faecd00d6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] HTTP exception thrown: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e37ab7d3-1863-4233-b925-345faecd00d6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Request method failure captured: Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: DELETE /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d HTTP/1.1 Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxOEkSw_D0B2DWW3aDp6JHSyeYSFkFADbNPgrw4so5mlP-Ugc06W6Rkqydb-b3AAsVzR7p1RzJdXA1668TSyot_sK8AkXdZkK5Jg9C97nHfO5kDuLQSdUnou_VoOzEQjYwBo46vUgiPeKNiJ0QlKMZ9JN2CFXzSZOPwjJ0bmZDR7mw Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:22:23.295275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:22:23.297760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6b24b42ca93941aa8e70f5fa10303f4d", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:22:23.297760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:23.297760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:23.297760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:23.297760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:23.297760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:22:23.297760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:22:23.297760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: dcb88983a8e1439588644b71170d7362 Sep 09 13:22:23.297760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:23.297760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:22:23.297760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:22:23.297760 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '67dfd749-af70-47be-a3de-523bc6cbd77d'} Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:22:23.298785 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:22:23.301644 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.303440 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-e37ab7d3-1863-4233-b925-345faecd00d6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Returning 404 to user: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:22:23.303440 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-e37ab7d3-1863-4233-b925-345faecd00d6 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 404 len: 111 microversion: 2.1 time: 0.033583 Sep 09 13:22:23.303440 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 531/1067] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:22:23 2022] DELETE /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 13:22:23.306100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e047607e-1582-4ebf-807c-a8635a1c33f3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:23.306714 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e047607e-1582-4ebf-807c-a8635a1c33f3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 67dfd749-af70-47be-a3de-523bc6cbd77d] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:23.314268 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e047607e-1582-4ebf-807c-a8635a1c33f3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:23.314762 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e047607e-1582-4ebf-807c-a8635a1c33f3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:23.315252 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e047607e-1582-4ebf-807c-a8635a1c33f3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:23.315973 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e047607e-1582-4ebf-807c-a8635a1c33f3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:23.316431 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e047607e-1582-4ebf-807c-a8635a1c33f3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:23.316867 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e047607e-1582-4ebf-807c-a8635a1c33f3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:23.331682 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-e047607e-1582-4ebf-807c-a8635a1c33f3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] HTTP exception thrown: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e047607e-1582-4ebf-807c-a8635a1c33f3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Request method failure captured: Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d HTTP/1.1 Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzxOEkSw_D0B2DWW3aDp6JHSyeYSFkFADbNPgrw4so5mlP-Ugc06W6Rkqydb-b3AAsVzR7p1RzJdXA1668TSyot_sK8AkXdZkK5Jg9C97nHfO5kDuLQSdUnou_VoOzEQjYwBo46vUgiPeKNiJ0QlKMZ9JN2CFXzSZOPwjJ0bmZDR7mw Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:22:23.333226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:22:23.334649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6b24b42ca93941aa8e70f5fa10303f4d", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:22:23.334649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:23.334649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:23.334649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:23.334649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:23.334649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:22:23.334649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:22:23.334649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: dcb88983a8e1439588644b71170d7362 Sep 09 13:22:23.334649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:23.334649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:22:23.334649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:22:23.334649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '67dfd749-af70-47be-a3de-523bc6cbd77d'} Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:22:23.337827 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. Sep 09 13:22:23.339284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:23.340498 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e047607e-1582-4ebf-807c-a8635a1c33f3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Returning 404 to user: Instance 67dfd749-af70-47be-a3de-523bc6cbd77d could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:22:23.340498 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e047607e-1582-4ebf-807c-a8635a1c33f3 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d" status: 404 len: 111 microversion: 2.1 time: 0.032368 Sep 09 13:22:23.340498 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 537/1068] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:23 2022] GET /compute/v2.1/servers/67dfd749-af70-47be-a3de-523bc6cbd77d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:22:23.570362 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1e8749f1-5810-4198-a547-52cf91b44121 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:23.572434 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-1e8749f1-5810-4198-a547-52cf91b44121 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:23.579884 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e8749f1-5810-4198-a547-52cf91b44121 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:23.580647 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e8749f1-5810-4198-a547-52cf91b44121 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:23.581287 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e8749f1-5810-4198-a547-52cf91b44121 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:23.582226 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e8749f1-5810-4198-a547-52cf91b44121 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:23.582864 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e8749f1-5810-4198-a547-52cf91b44121 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:23.583496 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-1e8749f1-5810-4198-a547-52cf91b44121 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:23.636538 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-22e2bd6c-f1e2-4eb0-bfbf-bdd26bd4eb62 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:23.637926 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-22e2bd6c-f1e2-4eb0-bfbf-bdd26bd4eb62 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:23.648127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22e2bd6c-f1e2-4eb0-bfbf-bdd26bd4eb62 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:23.652713 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22e2bd6c-f1e2-4eb0-bfbf-bdd26bd4eb62 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:23.654730 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22e2bd6c-f1e2-4eb0-bfbf-bdd26bd4eb62 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:23.660284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22e2bd6c-f1e2-4eb0-bfbf-bdd26bd4eb62 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:23.661692 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22e2bd6c-f1e2-4eb0-bfbf-bdd26bd4eb62 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:23.664699 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22e2bd6c-f1e2-4eb0-bfbf-bdd26bd4eb62 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:23.761815 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1e8749f1-5810-4198-a547-52cf91b44121 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:23.786421 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1e8749f1-5810-4198-a547-52cf91b44121 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:23.790858 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-1e8749f1-5810-4198-a547-52cf91b44121 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:23.792695 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1e8749f1-5810-4198-a547-52cf91b44121 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1740 microversion: 2.20 time: 0.226405 Sep 09 13:22:23.812541 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 532/1069] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:23 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:23.886891 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-22e2bd6c-f1e2-4eb0-bfbf-bdd26bd4eb62 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:23.898491 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-22e2bd6c-f1e2-4eb0-bfbf-bdd26bd4eb62 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1576 microversion: 2.1 time: 0.265980 Sep 09 13:22:23.899088 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 538/1070] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:23 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1576 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:22:24.500824 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-39c99213-9a6c-4b47-8ab0-d8e27859660c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:24.501338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-39c99213-9a6c-4b47-8ab0-d8e27859660c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:24.507714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-39c99213-9a6c-4b47-8ab0-d8e27859660c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:24.508209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-39c99213-9a6c-4b47-8ab0-d8e27859660c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:24.508648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-39c99213-9a6c-4b47-8ab0-d8e27859660c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:24.509350 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-39c99213-9a6c-4b47-8ab0-d8e27859660c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:24.509839 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-39c99213-9a6c-4b47-8ab0-d8e27859660c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:24.510267 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-39c99213-9a6c-4b47-8ab0-d8e27859660c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:24.525406 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-39c99213-9a6c-4b47-8ab0-d8e27859660c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] HTTP exception thrown: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-39c99213-9a6c-4b47-8ab0-d8e27859660c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Request method failure captured: Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: DELETE /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 HTTP/1.1 Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzxOEkSw_D0B2DWW3aDp6JHSyeYSFkFADbNPgrw4so5mlP-Ugc06W6Rkqydb-b3AAsVzR7p1RzJdXA1668TSyot_sK8AkXdZkK5Jg9C97nHfO5kDuLQSdUnou_VoOzEQjYwBo46vUgiPeKNiJ0QlKMZ9JN2CFXzSZOPwjJ0bmZDR7mw Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:22:24.526971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:22:24.528500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6b24b42ca93941aa8e70f5fa10303f4d", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:22:24.528500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:24.528500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:24.528500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:24.528500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:24.528500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:22:24.528500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:22:24.528500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: dcb88983a8e1439588644b71170d7362 Sep 09 13:22:24.528500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:24.528500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:22:24.528500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:22:24.528500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '14183836-171b-4a21-ae32-a214060081e8'} Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:22:24.529745 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:22:24.531338 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:22:24.534166 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-39c99213-9a6c-4b47-8ab0-d8e27859660c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Returning 404 to user: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:22:24.534166 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-39c99213-9a6c-4b47-8ab0-d8e27859660c tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "DELETE /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 404 len: 111 microversion: 2.1 time: 0.032835 Sep 09 13:22:24.534166 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 533/1071] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:22:24 2022] DELETE /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:22:24.537264 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3adec754-e12c-4d66-9220-53ac3df0b055 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:24.537891 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3adec754-e12c-4d66-9220-53ac3df0b055 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] [instance: 14183836-171b-4a21-ae32-a214060081e8] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:24.544681 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3adec754-e12c-4d66-9220-53ac3df0b055 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:24.545181 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3adec754-e12c-4d66-9220-53ac3df0b055 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:24.545627 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3adec754-e12c-4d66-9220-53ac3df0b055 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:24.546856 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3adec754-e12c-4d66-9220-53ac3df0b055 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:24.547362 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3adec754-e12c-4d66-9220-53ac3df0b055 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:24.547793 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3adec754-e12c-4d66-9220-53ac3df0b055 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:24.568960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3adec754-e12c-4d66-9220-53ac3df0b055 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] HTTP exception thrown: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3adec754-e12c-4d66-9220-53ac3df0b055 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Request method failure captured: Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 HTTP/1.1 Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzxOEkSw_D0B2DWW3aDp6JHSyeYSFkFADbNPgrw4so5mlP-Ugc06W6Rkqydb-b3AAsVzR7p1RzJdXA1668TSyot_sK8AkXdZkK5Jg9C97nHfO5kDuLQSdUnou_VoOzEQjYwBo46vUgiPeKNiJ0QlKMZ9JN2CFXzSZOPwjJ0bmZDR7mw Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:22:24.570519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:22:24.572130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6b24b42ca93941aa8e70f5fa10303f4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6b24b42ca93941aa8e70f5fa10303f4d", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:22:24.572130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:24.572130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 6b24b42ca93941aa8e70f5fa10303f4d Sep 09 13:22:24.572130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242743987 Sep 09 13:22:24.572130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:24.572130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:22:24.572130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:22:24.572130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: dcb88983a8e1439588644b71170d7362 Sep 09 13:22:24.572130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeNegativeTest-1242743987-project Sep 09 13:22:24.572130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:22:24.572130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:22:24.572130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '14183836-171b-4a21-ae32-a214060081e8'} Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:22:24.572936 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. Sep 09 13:22:24.578057 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:22:24.580282 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3adec754-e12c-4d66-9220-53ac3df0b055 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] Returning 404 to user: Instance 14183836-171b-4a21-ae32-a214060081e8 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:22:24.580282 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3adec754-e12c-4d66-9220-53ac3df0b055 tempest-AttachVolumeNegativeTest-1242743987 tempest-AttachVolumeNegativeTest-1242743987-project] 10.222.0.17 "GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8" status: 404 len: 111 microversion: 2.1 time: 0.039166 Sep 09 13:22:24.580282 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 539/1072] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:24 2022] GET /compute/v2.1/servers/14183836-171b-4a21-ae32-a214060081e8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:22:24.824953 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-350633c8-835f-46f8-85a5-8881916742dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:24.826437 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-350633c8-835f-46f8-85a5-8881916742dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:24.834309 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-350633c8-835f-46f8-85a5-8881916742dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:24.835252 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-350633c8-835f-46f8-85a5-8881916742dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:24.835929 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-350633c8-835f-46f8-85a5-8881916742dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:24.837123 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-350633c8-835f-46f8-85a5-8881916742dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:24.837832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-350633c8-835f-46f8-85a5-8881916742dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:24.841336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-350633c8-835f-46f8-85a5-8881916742dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:24.923895 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5ccb06e7-0452-480a-8663-49c04c6e492e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:24.926808 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5ccb06e7-0452-480a-8663-49c04c6e492e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:24.938613 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ccb06e7-0452-480a-8663-49c04c6e492e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:24.939838 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ccb06e7-0452-480a-8663-49c04c6e492e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:24.940785 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ccb06e7-0452-480a-8663-49c04c6e492e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:24.941746 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ccb06e7-0452-480a-8663-49c04c6e492e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:24.942422 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ccb06e7-0452-480a-8663-49c04c6e492e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:24.943082 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-5ccb06e7-0452-480a-8663-49c04c6e492e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:25.088961 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-350633c8-835f-46f8-85a5-8881916742dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:25.100029 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-350633c8-835f-46f8-85a5-8881916742dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:25.101906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-350633c8-835f-46f8-85a5-8881916742dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:25.103372 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-350633c8-835f-46f8-85a5-8881916742dd tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1740 microversion: 2.20 time: 0.282859 Sep 09 13:22:25.118857 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5ccb06e7-0452-480a-8663-49c04c6e492e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:25.119443 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 534/1073] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:24 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:25.129044 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5ccb06e7-0452-480a-8663-49c04c6e492e tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1563 microversion: 2.1 time: 0.211075 Sep 09 13:22:25.130205 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 540/1074] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:22:24 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1563 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:22:26.131629 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-09ca241d-b39a-4edb-a6b6-98b07f90d710 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:26.132308 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-09ca241d-b39a-4edb-a6b6-98b07f90d710 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:26.142911 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09ca241d-b39a-4edb-a6b6-98b07f90d710 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:26.147651 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09ca241d-b39a-4edb-a6b6-98b07f90d710 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:26.147651 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09ca241d-b39a-4edb-a6b6-98b07f90d710 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:26.147651 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09ca241d-b39a-4edb-a6b6-98b07f90d710 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:26.147651 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09ca241d-b39a-4edb-a6b6-98b07f90d710 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:26.148153 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-09ca241d-b39a-4edb-a6b6-98b07f90d710 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:26.653893 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-09ca241d-b39a-4edb-a6b6-98b07f90d710 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:26.666129 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-09ca241d-b39a-4edb-a6b6-98b07f90d710 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:26.667650 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-09ca241d-b39a-4edb-a6b6-98b07f90d710 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:26.668855 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-09ca241d-b39a-4edb-a6b6-98b07f90d710 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1740 microversion: 2.20 time: 0.541206 Sep 09 13:22:26.684487 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 535/1075] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:26 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1740 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:27.696231 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e53e81f8-3345-49d9-8a2f-ebf5ee6e0ab2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:27.696847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e53e81f8-3345-49d9-8a2f-ebf5ee6e0ab2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:27.703562 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53e81f8-3345-49d9-8a2f-ebf5ee6e0ab2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:27.704298 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53e81f8-3345-49d9-8a2f-ebf5ee6e0ab2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:27.704905 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53e81f8-3345-49d9-8a2f-ebf5ee6e0ab2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:27.705774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53e81f8-3345-49d9-8a2f-ebf5ee6e0ab2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:27.706392 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53e81f8-3345-49d9-8a2f-ebf5ee6e0ab2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:27.706980 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e53e81f8-3345-49d9-8a2f-ebf5ee6e0ab2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:27.894408 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e53e81f8-3345-49d9-8a2f-ebf5ee6e0ab2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:27.918546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e53e81f8-3345-49d9-8a2f-ebf5ee6e0ab2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:27.920106 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e53e81f8-3345-49d9-8a2f-ebf5ee6e0ab2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:27.921545 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e53e81f8-3345-49d9-8a2f-ebf5ee6e0ab2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1740 microversion: 2.20 time: 0.229167 Sep 09 13:22:27.922583 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 541/1076] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:27 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:28.948689 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fc079baa-954c-41d4-b7aa-b897f9274119 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:28.950277 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fc079baa-954c-41d4-b7aa-b897f9274119 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:28.957458 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc079baa-954c-41d4-b7aa-b897f9274119 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:28.958047 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc079baa-954c-41d4-b7aa-b897f9274119 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:28.958619 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc079baa-954c-41d4-b7aa-b897f9274119 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:28.959447 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc079baa-954c-41d4-b7aa-b897f9274119 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:28.960477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc079baa-954c-41d4-b7aa-b897f9274119 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:28.961066 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fc079baa-954c-41d4-b7aa-b897f9274119 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:29.113583 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fc079baa-954c-41d4-b7aa-b897f9274119 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:29.121755 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fc079baa-954c-41d4-b7aa-b897f9274119 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:29.123239 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fc079baa-954c-41d4-b7aa-b897f9274119 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:29.124869 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fc079baa-954c-41d4-b7aa-b897f9274119 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1722 microversion: 2.20 time: 0.179950 Sep 09 13:22:29.125505 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 536/1077] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:28 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:30.151851 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-adacd21b-55dc-42ef-8f1c-28af1aabc46a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:30.152494 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-adacd21b-55dc-42ef-8f1c-28af1aabc46a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:30.159546 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adacd21b-55dc-42ef-8f1c-28af1aabc46a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:30.160031 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adacd21b-55dc-42ef-8f1c-28af1aabc46a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:30.160469 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adacd21b-55dc-42ef-8f1c-28af1aabc46a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:30.161163 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adacd21b-55dc-42ef-8f1c-28af1aabc46a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:30.161615 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adacd21b-55dc-42ef-8f1c-28af1aabc46a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:30.162036 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-adacd21b-55dc-42ef-8f1c-28af1aabc46a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:30.300818 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-adacd21b-55dc-42ef-8f1c-28af1aabc46a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:30.308724 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-adacd21b-55dc-42ef-8f1c-28af1aabc46a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:30.310156 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-adacd21b-55dc-42ef-8f1c-28af1aabc46a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:30.311317 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-adacd21b-55dc-42ef-8f1c-28af1aabc46a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1722 microversion: 2.20 time: 0.163401 Sep 09 13:22:30.311875 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 542/1078] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:30 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:31.337290 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5f7c1671-f235-4625-b7a9-5b4ffd12d88d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:31.337962 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5f7c1671-f235-4625-b7a9-5b4ffd12d88d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:31.348478 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5f7c1671-f235-4625-b7a9-5b4ffd12d88d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:31.348991 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5f7c1671-f235-4625-b7a9-5b4ffd12d88d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:31.349433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5f7c1671-f235-4625-b7a9-5b4ffd12d88d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:31.350138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5f7c1671-f235-4625-b7a9-5b4ffd12d88d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:31.350593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5f7c1671-f235-4625-b7a9-5b4ffd12d88d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:31.351021 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5f7c1671-f235-4625-b7a9-5b4ffd12d88d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:31.487266 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5f7c1671-f235-4625-b7a9-5b4ffd12d88d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:31.499387 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5f7c1671-f235-4625-b7a9-5b4ffd12d88d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:31.502106 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5f7c1671-f235-4625-b7a9-5b4ffd12d88d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:31.503307 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5f7c1671-f235-4625-b7a9-5b4ffd12d88d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1665 microversion: 2.20 time: 0.171078 Sep 09 13:22:31.503870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 537/1079] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:31 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1665 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:31.529453 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9a2980b4-a838-4558-98c0-cad2f90f95b2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dab441d8-459c-4944-b2b4-9dfd34f83f1a"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:22:31.532043 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9a2980b4-a838-4558-98c0-cad2f90f95b2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:31.538282 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2980b4-a838-4558-98c0-cad2f90f95b2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:31.538803 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2980b4-a838-4558-98c0-cad2f90f95b2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:31.539276 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2980b4-a838-4558-98c0-cad2f90f95b2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:31.540001 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2980b4-a838-4558-98c0-cad2f90f95b2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:31.540448 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2980b4-a838-4558-98c0-cad2f90f95b2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:31.540878 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9a2980b4-a838-4558-98c0-cad2f90f95b2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:31.840355 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9a2980b4-a838-4558-98c0-cad2f90f95b2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "POST /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314847 Sep 09 13:22:31.841004 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 543/1080] 10.222.0.17 () {62 vars in 1364 bytes} [Fri Sep 9 13:22:31 2022] POST /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f/os-volume_attachments => generated 188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 13:22:31.877911 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-c72aab99-4030-4b41-81f6-0a3185a0bff5 req-f9891e73-34ce-4089-a461-3a9b0ca20d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bed376-e738-4913-8eea-71014b54ed1f", "name": "network-vif-unplugged", "status": "completed", "tag": "38c754fd-a2fb-4031-a376-b82c80b97094"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:22:31.888618 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-c72aab99-4030-4b41-81f6-0a3185a0bff5 req-f9891e73-34ce-4089-a461-3a9b0ca20d39 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:31.889296 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-c72aab99-4030-4b41-81f6-0a3185a0bff5 req-f9891e73-34ce-4089-a461-3a9b0ca20d39 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:31.889891 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-c72aab99-4030-4b41-81f6-0a3185a0bff5 req-f9891e73-34ce-4089-a461-3a9b0ca20d39 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:31.904230 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.compute.server_external_events [req-c72aab99-4030-4b41-81f6-0a3185a0bff5 req-f9891e73-34ce-4089-a461-3a9b0ca20d39 service nova] Unable to find a host for instance b2bed376-e738-4913-8eea-71014b54ed1f. Dropping event network-vif-unplugged {{(pid=120623) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 13:22:31.905302 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-c72aab99-4030-4b41-81f6-0a3185a0bff5 req-f9891e73-34ce-4089-a461-3a9b0ca20d39 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032081 Sep 09 13:22:31.906198 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 538/1081] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 13:22:31.995484 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-429b9171-aa4e-4792-a8b5-c778d80be43f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:31.995974 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-429b9171-aa4e-4792-a8b5-c778d80be43f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:32.002635 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-429b9171-aa4e-4792-a8b5-c778d80be43f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:32.003149 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-429b9171-aa4e-4792-a8b5-c778d80be43f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:32.003580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-429b9171-aa4e-4792-a8b5-c778d80be43f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:32.004264 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-429b9171-aa4e-4792-a8b5-c778d80be43f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:32.004709 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-429b9171-aa4e-4792-a8b5-c778d80be43f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:32.005126 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-429b9171-aa4e-4792-a8b5-c778d80be43f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:32.253854 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-429b9171-aa4e-4792-a8b5-c778d80be43f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f/os-volume_attachments/dab441d8-459c-4944-b2b4-9dfd34f83f1a" status: 202 len: 0 microversion: 2.20 time: 0.262169 Sep 09 13:22:32.254462 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 544/1082] 10.222.0.17 () {60 vars in 1457 bytes} [Fri Sep 9 13:22:31 2022] DELETE /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f/os-volume_attachments/dab441d8-459c-4944-b2b4-9dfd34f83f1a => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:22:32.317170 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8ac54be2-55d9-4d7f-9cf2-b205a66ecb1f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:22:32.317791 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8ac54be2-55d9-4d7f-9cf2-b205a66ecb1f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:32.323744 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ac54be2-55d9-4d7f-9cf2-b205a66ecb1f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:32.324232 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ac54be2-55d9-4d7f-9cf2-b205a66ecb1f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:32.324672 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ac54be2-55d9-4d7f-9cf2-b205a66ecb1f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:32.325372 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ac54be2-55d9-4d7f-9cf2-b205a66ecb1f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:32.325831 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ac54be2-55d9-4d7f-9cf2-b205a66ecb1f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:32.326260 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8ac54be2-55d9-4d7f-9cf2-b205a66ecb1f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:32.358887 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8ac54be2-55d9-4d7f-9cf2-b205a66ecb1f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120623) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 13:22:32.442103 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8ac54be2-55d9-4d7f-9cf2-b205a66ecb1f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "POST /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f/action" status: 202 len: 0 microversion: 2.20 time: 0.129041 Sep 09 13:22:32.442711 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 539/1083] 10.222.0.17 () {62 vars in 1319 bytes} [Fri Sep 9 13:22:32 2022] POST /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 09 13:22:32.451257 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-64af8959-9c2c-4138-a1f1-636709f82973 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:32.452142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64af8959-9c2c-4138-a1f1-636709f82973 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:32.458796 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64af8959-9c2c-4138-a1f1-636709f82973 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:32.459320 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64af8959-9c2c-4138-a1f1-636709f82973 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:32.459750 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64af8959-9c2c-4138-a1f1-636709f82973 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:32.460635 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64af8959-9c2c-4138-a1f1-636709f82973 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:32.461098 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64af8959-9c2c-4138-a1f1-636709f82973 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:32.461503 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64af8959-9c2c-4138-a1f1-636709f82973 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:32.622023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-64af8959-9c2c-4138-a1f1-636709f82973 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:32.632466 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-64af8959-9c2c-4138-a1f1-636709f82973 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:32.634100 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-64af8959-9c2c-4138-a1f1-636709f82973 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:32.635424 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-64af8959-9c2c-4138-a1f1-636709f82973 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1673 microversion: 2.20 time: 0.188007 Sep 09 13:22:32.635967 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 545/1084] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:32 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1673 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:22:33.661697 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-72be3413-2f2a-4a66-8ea3-1808fb155e6c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:33.663219 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-72be3413-2f2a-4a66-8ea3-1808fb155e6c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:33.671719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72be3413-2f2a-4a66-8ea3-1808fb155e6c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:33.672974 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72be3413-2f2a-4a66-8ea3-1808fb155e6c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:33.673807 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72be3413-2f2a-4a66-8ea3-1808fb155e6c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:33.674594 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72be3413-2f2a-4a66-8ea3-1808fb155e6c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:33.675246 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72be3413-2f2a-4a66-8ea3-1808fb155e6c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:33.675896 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-72be3413-2f2a-4a66-8ea3-1808fb155e6c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:33.818175 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-72be3413-2f2a-4a66-8ea3-1808fb155e6c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:33.827657 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-72be3413-2f2a-4a66-8ea3-1808fb155e6c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:33.829818 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-72be3413-2f2a-4a66-8ea3-1808fb155e6c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:33.831788 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-72be3413-2f2a-4a66-8ea3-1808fb155e6c tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1673 microversion: 2.20 time: 0.173850 Sep 09 13:22:33.843802 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 540/1085] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:33 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1673 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:22:34.858257 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9c21f632-91ed-4629-ad32-fcacb0f0ee95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:34.859400 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9c21f632-91ed-4629-ad32-fcacb0f0ee95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:34.880330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c21f632-91ed-4629-ad32-fcacb0f0ee95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:34.880830 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c21f632-91ed-4629-ad32-fcacb0f0ee95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:34.881266 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c21f632-91ed-4629-ad32-fcacb0f0ee95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:34.881981 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c21f632-91ed-4629-ad32-fcacb0f0ee95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:34.882440 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c21f632-91ed-4629-ad32-fcacb0f0ee95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:34.882862 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9c21f632-91ed-4629-ad32-fcacb0f0ee95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:35.022572 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9c21f632-91ed-4629-ad32-fcacb0f0ee95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:35.031445 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9c21f632-91ed-4629-ad32-fcacb0f0ee95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:35.032927 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9c21f632-91ed-4629-ad32-fcacb0f0ee95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:35.034059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9c21f632-91ed-4629-ad32-fcacb0f0ee95 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1731 microversion: 2.20 time: 0.180220 Sep 09 13:22:35.034612 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 546/1086] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:34 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:36.060012 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-516635d3-9f46-42d7-9bd2-45235938bf3d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:36.060612 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-516635d3-9f46-42d7-9bd2-45235938bf3d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:36.068492 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-516635d3-9f46-42d7-9bd2-45235938bf3d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:36.069071 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-516635d3-9f46-42d7-9bd2-45235938bf3d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:36.069511 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-516635d3-9f46-42d7-9bd2-45235938bf3d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:36.070211 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-516635d3-9f46-42d7-9bd2-45235938bf3d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:36.070670 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-516635d3-9f46-42d7-9bd2-45235938bf3d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:36.071179 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-516635d3-9f46-42d7-9bd2-45235938bf3d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:36.224973 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-516635d3-9f46-42d7-9bd2-45235938bf3d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:36.238913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-516635d3-9f46-42d7-9bd2-45235938bf3d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:36.241800 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-516635d3-9f46-42d7-9bd2-45235938bf3d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:36.247738 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-516635d3-9f46-42d7-9bd2-45235938bf3d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1731 microversion: 2.20 time: 0.191526 Sep 09 13:22:36.248674 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 541/1087] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:36 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:37.278599 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-22239eed-7943-4046-9202-f20edc3648d8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:37.280162 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-22239eed-7943-4046-9202-f20edc3648d8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:37.288245 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=66 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:37.290171 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22239eed-7943-4046-9202-f20edc3648d8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:37.290763 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22239eed-7943-4046-9202-f20edc3648d8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:37.291403 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22239eed-7943-4046-9202-f20edc3648d8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:37.292330 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22239eed-7943-4046-9202-f20edc3648d8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:37.292955 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22239eed-7943-4046-9202-f20edc3648d8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:37.293392 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-22239eed-7943-4046-9202-f20edc3648d8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:37.441653 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-22239eed-7943-4046-9202-f20edc3648d8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:37.449803 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-22239eed-7943-4046-9202-f20edc3648d8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:37.451476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-22239eed-7943-4046-9202-f20edc3648d8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:37.453616 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-22239eed-7943-4046-9202-f20edc3648d8 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1731 microversion: 2.20 time: 0.179388 Sep 09 13:22:37.454185 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 547/1088] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:37 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:38.481470 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2f7481e1-0b24-4c61-9ca7-789c71e340a0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:38.482418 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2f7481e1-0b24-4c61-9ca7-789c71e340a0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:38.491364 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f7481e1-0b24-4c61-9ca7-789c71e340a0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:38.492532 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f7481e1-0b24-4c61-9ca7-789c71e340a0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:38.493207 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f7481e1-0b24-4c61-9ca7-789c71e340a0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:38.494154 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f7481e1-0b24-4c61-9ca7-789c71e340a0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:38.494807 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f7481e1-0b24-4c61-9ca7-789c71e340a0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:38.495454 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2f7481e1-0b24-4c61-9ca7-789c71e340a0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:38.668752 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2f7481e1-0b24-4c61-9ca7-789c71e340a0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:38.678846 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2f7481e1-0b24-4c61-9ca7-789c71e340a0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:38.680853 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2f7481e1-0b24-4c61-9ca7-789c71e340a0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:38.683221 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2f7481e1-0b24-4c61-9ca7-789c71e340a0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1731 microversion: 2.20 time: 0.205490 Sep 09 13:22:38.684148 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 542/1089] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:38 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:39.715781 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-69bc48f1-09dd-47ef-a740-de21bc413995 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:39.716434 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-69bc48f1-09dd-47ef-a740-de21bc413995 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:39.731033 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69bc48f1-09dd-47ef-a740-de21bc413995 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:39.732751 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69bc48f1-09dd-47ef-a740-de21bc413995 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:39.733585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69bc48f1-09dd-47ef-a740-de21bc413995 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:39.735756 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69bc48f1-09dd-47ef-a740-de21bc413995 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:39.737197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69bc48f1-09dd-47ef-a740-de21bc413995 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:39.738505 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-69bc48f1-09dd-47ef-a740-de21bc413995 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:39.744636 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:39.971909 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-69bc48f1-09dd-47ef-a740-de21bc413995 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:39.981538 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-69bc48f1-09dd-47ef-a740-de21bc413995 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:39.985023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-69bc48f1-09dd-47ef-a740-de21bc413995 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:39.987487 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-69bc48f1-09dd-47ef-a740-de21bc413995 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1731 microversion: 2.20 time: 0.276925 Sep 09 13:22:39.988716 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 548/1090] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:39 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1731 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:41.016737 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-616725cf-342f-4df0-a379-087966b09589 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:41.017828 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-616725cf-342f-4df0-a379-087966b09589 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:41.024206 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-616725cf-342f-4df0-a379-087966b09589 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:41.024955 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-616725cf-342f-4df0-a379-087966b09589 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:41.025584 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-616725cf-342f-4df0-a379-087966b09589 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:41.026476 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-616725cf-342f-4df0-a379-087966b09589 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:41.027169 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-616725cf-342f-4df0-a379-087966b09589 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:41.027759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-616725cf-342f-4df0-a379-087966b09589 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:41.186665 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-616725cf-342f-4df0-a379-087966b09589 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:41.197033 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-616725cf-342f-4df0-a379-087966b09589 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:41.198771 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-616725cf-342f-4df0-a379-087966b09589 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:41.199854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-616725cf-342f-4df0-a379-087966b09589 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1731 microversion: 2.20 time: 0.187840 Sep 09 13:22:41.200587 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 543/1091] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:41 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:42.226609 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cea2109a-df29-445a-90da-90f1ec6c144a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:42.227277 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cea2109a-df29-445a-90da-90f1ec6c144a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:42.238567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cea2109a-df29-445a-90da-90f1ec6c144a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:42.239318 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cea2109a-df29-445a-90da-90f1ec6c144a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:42.239822 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cea2109a-df29-445a-90da-90f1ec6c144a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:42.240586 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cea2109a-df29-445a-90da-90f1ec6c144a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:42.241197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cea2109a-df29-445a-90da-90f1ec6c144a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:42.241730 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cea2109a-df29-445a-90da-90f1ec6c144a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:42.404360 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cea2109a-df29-445a-90da-90f1ec6c144a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:42.417290 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cea2109a-df29-445a-90da-90f1ec6c144a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:42.419026 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cea2109a-df29-445a-90da-90f1ec6c144a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:42.420574 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cea2109a-df29-445a-90da-90f1ec6c144a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1731 microversion: 2.20 time: 0.197968 Sep 09 13:22:42.440962 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 549/1092] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:42 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:43.447732 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fd4621dc-eb49-464c-9b85-96ce88648890 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:43.448343 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fd4621dc-eb49-464c-9b85-96ce88648890 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:43.454915 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd4621dc-eb49-464c-9b85-96ce88648890 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:43.455431 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd4621dc-eb49-464c-9b85-96ce88648890 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:43.455864 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd4621dc-eb49-464c-9b85-96ce88648890 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:43.456553 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd4621dc-eb49-464c-9b85-96ce88648890 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:43.457005 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd4621dc-eb49-464c-9b85-96ce88648890 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:43.457433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fd4621dc-eb49-464c-9b85-96ce88648890 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:43.588252 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fd4621dc-eb49-464c-9b85-96ce88648890 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:43.596550 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fd4621dc-eb49-464c-9b85-96ce88648890 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:43.597996 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fd4621dc-eb49-464c-9b85-96ce88648890 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:43.599178 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fd4621dc-eb49-464c-9b85-96ce88648890 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1731 microversion: 2.20 time: 0.155388 Sep 09 13:22:43.599730 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 544/1093] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:43 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:44.626054 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6a75eb79-96f6-4f78-a1d6-92ce86a6b559 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:44.626669 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6a75eb79-96f6-4f78-a1d6-92ce86a6b559 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:44.633182 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a75eb79-96f6-4f78-a1d6-92ce86a6b559 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:44.633662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a75eb79-96f6-4f78-a1d6-92ce86a6b559 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:44.634089 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a75eb79-96f6-4f78-a1d6-92ce86a6b559 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:44.634778 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a75eb79-96f6-4f78-a1d6-92ce86a6b559 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:44.635259 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a75eb79-96f6-4f78-a1d6-92ce86a6b559 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:44.635684 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6a75eb79-96f6-4f78-a1d6-92ce86a6b559 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:44.763146 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6a75eb79-96f6-4f78-a1d6-92ce86a6b559 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:44.771367 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6a75eb79-96f6-4f78-a1d6-92ce86a6b559 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:44.772797 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6a75eb79-96f6-4f78-a1d6-92ce86a6b559 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:44.773932 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6a75eb79-96f6-4f78-a1d6-92ce86a6b559 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1731 microversion: 2.20 time: 0.152871 Sep 09 13:22:44.774482 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 550/1094] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:44 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:45.800301 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9874d6d8-924f-4ec7-a020-357d38ff4e83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:45.800979 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9874d6d8-924f-4ec7-a020-357d38ff4e83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:45.807512 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9874d6d8-924f-4ec7-a020-357d38ff4e83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:45.807907 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9874d6d8-924f-4ec7-a020-357d38ff4e83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:45.808339 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9874d6d8-924f-4ec7-a020-357d38ff4e83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:45.809041 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9874d6d8-924f-4ec7-a020-357d38ff4e83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:45.809497 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9874d6d8-924f-4ec7-a020-357d38ff4e83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:45.809924 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9874d6d8-924f-4ec7-a020-357d38ff4e83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:45.950863 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9874d6d8-924f-4ec7-a020-357d38ff4e83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:45.954904 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:45.961540 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9874d6d8-924f-4ec7-a020-357d38ff4e83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:45.962987 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9874d6d8-924f-4ec7-a020-357d38ff4e83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:45.964197 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9874d6d8-924f-4ec7-a020-357d38ff4e83 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1731 microversion: 2.20 time: 0.168031 Sep 09 13:22:45.964759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 545/1095] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:45 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:46.990510 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4dcba2de-ef60-48d2-a336-8d98e686d6cb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:46.991134 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4dcba2de-ef60-48d2-a336-8d98e686d6cb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:46.997404 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4dcba2de-ef60-48d2-a336-8d98e686d6cb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:46.997880 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4dcba2de-ef60-48d2-a336-8d98e686d6cb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:46.998309 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4dcba2de-ef60-48d2-a336-8d98e686d6cb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:46.999904 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4dcba2de-ef60-48d2-a336-8d98e686d6cb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:47.000358 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4dcba2de-ef60-48d2-a336-8d98e686d6cb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:47.000770 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-4dcba2de-ef60-48d2-a336-8d98e686d6cb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:47.139243 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4dcba2de-ef60-48d2-a336-8d98e686d6cb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:47.147633 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4dcba2de-ef60-48d2-a336-8d98e686d6cb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:47.149070 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4dcba2de-ef60-48d2-a336-8d98e686d6cb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:47.150217 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4dcba2de-ef60-48d2-a336-8d98e686d6cb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1731 microversion: 2.20 time: 0.163698 Sep 09 13:22:47.150761 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 551/1096] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:46 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:48.101925 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-41de1c5c-2ec2-429f-876e-45dd2a07d375 req-1669ea71-2a4b-43e0-92c8-4792d5f469f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bed376-e738-4913-8eea-71014b54ed1f", "name": "network-vif-plugged", "status": "completed", "tag": "38c754fd-a2fb-4031-a376-b82c80b97094"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:22:48.107212 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:22:48.113994 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-41de1c5c-2ec2-429f-876e-45dd2a07d375 req-1669ea71-2a4b-43e0-92c8-4792d5f469f4 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:48.114480 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-41de1c5c-2ec2-429f-876e-45dd2a07d375 req-1669ea71-2a4b-43e0-92c8-4792d5f469f4 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:48.114907 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-41de1c5c-2ec2-429f-876e-45dd2a07d375 req-1669ea71-2a4b-43e0-92c8-4792d5f469f4 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:48.128347 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-41de1c5c-2ec2-429f-876e-45dd2a07d375 req-1669ea71-2a4b-43e0-92c8-4792d5f469f4 service nova] Creating event network-vif-plugged:38c754fd-a2fb-4031-a376-b82c80b97094 for instance b2bed376-e738-4913-8eea-71014b54ed1f on hv-cinder-83124 Sep 09 13:22:48.133603 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-41de1c5c-2ec2-429f-876e-45dd2a07d375 req-1669ea71-2a4b-43e0-92c8-4792d5f469f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035643 Sep 09 13:22:48.134255 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 546/1097] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:22:48.175804 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-28538ce6-39d8-493b-bb93-17e3d02112bb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:48.177322 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-28538ce6-39d8-493b-bb93-17e3d02112bb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:48.184053 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28538ce6-39d8-493b-bb93-17e3d02112bb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:48.184542 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28538ce6-39d8-493b-bb93-17e3d02112bb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:48.184987 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28538ce6-39d8-493b-bb93-17e3d02112bb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:48.186231 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28538ce6-39d8-493b-bb93-17e3d02112bb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:48.187328 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28538ce6-39d8-493b-bb93-17e3d02112bb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:48.188174 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-28538ce6-39d8-493b-bb93-17e3d02112bb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:48.359927 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-28538ce6-39d8-493b-bb93-17e3d02112bb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:48.370281 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-28538ce6-39d8-493b-bb93-17e3d02112bb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:48.373299 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-28538ce6-39d8-493b-bb93-17e3d02112bb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:48.377512 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-28538ce6-39d8-493b-bb93-17e3d02112bb tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1731 microversion: 2.20 time: 0.205774 Sep 09 13:22:48.378894 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 552/1098] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:48 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:49.405001 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ecfae88c-ebc6-4377-941b-8fb7fba00cdc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:49.406463 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ecfae88c-ebc6-4377-941b-8fb7fba00cdc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:49.412608 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ecfae88c-ebc6-4377-941b-8fb7fba00cdc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:49.413093 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ecfae88c-ebc6-4377-941b-8fb7fba00cdc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:49.413528 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ecfae88c-ebc6-4377-941b-8fb7fba00cdc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:49.414217 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ecfae88c-ebc6-4377-941b-8fb7fba00cdc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:49.414670 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ecfae88c-ebc6-4377-941b-8fb7fba00cdc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:49.415145 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ecfae88c-ebc6-4377-941b-8fb7fba00cdc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:49.548057 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ecfae88c-ebc6-4377-941b-8fb7fba00cdc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:49.556221 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ecfae88c-ebc6-4377-941b-8fb7fba00cdc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:49.557940 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ecfae88c-ebc6-4377-941b-8fb7fba00cdc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:49.559329 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ecfae88c-ebc6-4377-941b-8fb7fba00cdc tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1731 microversion: 2.20 time: 0.158890 Sep 09 13:22:49.559961 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 547/1099] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:49 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:50.585682 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1b935b1f-38fa-48df-95f6-e60565fa0d4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:50.586302 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1b935b1f-38fa-48df-95f6-e60565fa0d4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:50.593054 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b935b1f-38fa-48df-95f6-e60565fa0d4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:50.593602 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b935b1f-38fa-48df-95f6-e60565fa0d4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:50.594252 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b935b1f-38fa-48df-95f6-e60565fa0d4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:50.594967 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b935b1f-38fa-48df-95f6-e60565fa0d4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:50.595486 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b935b1f-38fa-48df-95f6-e60565fa0d4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:50.596543 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1b935b1f-38fa-48df-95f6-e60565fa0d4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:50.737639 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1b935b1f-38fa-48df-95f6-e60565fa0d4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:50.751590 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1b935b1f-38fa-48df-95f6-e60565fa0d4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:50.753092 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1b935b1f-38fa-48df-95f6-e60565fa0d4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:50.754276 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1b935b1f-38fa-48df-95f6-e60565fa0d4d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1731 microversion: 2.20 time: 0.172626 Sep 09 13:22:50.755857 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 553/1100] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:50 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:22:51.782328 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d61af2a5-8357-4ec3-8434-634f57cd8f2d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:22:51.782949 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d61af2a5-8357-4ec3-8434-634f57cd8f2d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:22:51.789459 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d61af2a5-8357-4ec3-8434-634f57cd8f2d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:51.789970 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d61af2a5-8357-4ec3-8434-634f57cd8f2d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:51.790411 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d61af2a5-8357-4ec3-8434-634f57cd8f2d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:51.791131 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d61af2a5-8357-4ec3-8434-634f57cd8f2d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:22:51.791592 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d61af2a5-8357-4ec3-8434-634f57cd8f2d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:22:51.792022 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d61af2a5-8357-4ec3-8434-634f57cd8f2d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:22:51.934699 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d61af2a5-8357-4ec3-8434-634f57cd8f2d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:51.942901 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d61af2a5-8357-4ec3-8434-634f57cd8f2d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:51.944367 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d61af2a5-8357-4ec3-8434-634f57cd8f2d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:22:51.945512 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d61af2a5-8357-4ec3-8434-634f57cd8f2d tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1718 microversion: 2.20 time: 0.167129 Sep 09 13:22:51.946063 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 548/1101] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:22:51 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1718 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:23:25.353611 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-f3d50f71-9dc6-4b9d-a381-98f2145435d0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:25.355886 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-f3d50f71-9dc6-4b9d-a381-98f2145435d0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:25.357893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=13 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:23:25.358544 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=35 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:23:25.365202 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3d50f71-9dc6-4b9d-a381-98f2145435d0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:25.365689 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3d50f71-9dc6-4b9d-a381-98f2145435d0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:25.366128 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3d50f71-9dc6-4b9d-a381-98f2145435d0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:25.366817 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3d50f71-9dc6-4b9d-a381-98f2145435d0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:25.367306 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3d50f71-9dc6-4b9d-a381-98f2145435d0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:25.367741 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-f3d50f71-9dc6-4b9d-a381-98f2145435d0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:25.397991 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-f3d50f71-9dc6-4b9d-a381-98f2145435d0 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048539 Sep 09 13:23:25.398539 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 554/1102] 10.222.0.17 () {60 vars in 1343 bytes} [Fri Sep 9 13:23:25 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:23:25.460900 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f20c7f26-514e-44f4-88b9-854beffdf15a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:25.461416 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f20c7f26-514e-44f4-88b9-854beffdf15a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:25.464795 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=5 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:23:25.465446 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=14 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:23:25.471345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f20c7f26-514e-44f4-88b9-854beffdf15a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:25.471825 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f20c7f26-514e-44f4-88b9-854beffdf15a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:25.472255 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f20c7f26-514e-44f4-88b9-854beffdf15a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:25.472938 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f20c7f26-514e-44f4-88b9-854beffdf15a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:25.473389 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f20c7f26-514e-44f4-88b9-854beffdf15a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:25.473808 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f20c7f26-514e-44f4-88b9-854beffdf15a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:25.498724 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f20c7f26-514e-44f4-88b9-854beffdf15a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:23:25.573391 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f20c7f26-514e-44f4-88b9-854beffdf15a tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 204 len: 0 microversion: 2.20 time: 0.115912 Sep 09 13:23:25.573870 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 549/1103] 10.222.0.17 () {60 vars in 1280 bytes} [Fri Sep 9 13:23:25 2022] DELETE /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 13:23:25.583768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bf56422d-28f3-4d1a-b5cf-0c18df5f9b43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:25.584429 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bf56422d-28f3-4d1a-b5cf-0c18df5f9b43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:25.590884 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf56422d-28f3-4d1a-b5cf-0c18df5f9b43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:25.591400 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf56422d-28f3-4d1a-b5cf-0c18df5f9b43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:25.591830 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf56422d-28f3-4d1a-b5cf-0c18df5f9b43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:25.592530 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf56422d-28f3-4d1a-b5cf-0c18df5f9b43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:25.592966 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf56422d-28f3-4d1a-b5cf-0c18df5f9b43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:25.593382 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bf56422d-28f3-4d1a-b5cf-0c18df5f9b43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:25.727970 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bf56422d-28f3-4d1a-b5cf-0c18df5f9b43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:23:25.736237 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bf56422d-28f3-4d1a-b5cf-0c18df5f9b43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:23:25.737688 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bf56422d-28f3-4d1a-b5cf-0c18df5f9b43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:23:25.738837 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bf56422d-28f3-4d1a-b5cf-0c18df5f9b43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.160308 Sep 09 13:23:25.739422 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 555/1104] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:23:25 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 13:23:26.765660 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-56a23f17-6092-4d5e-b518-7ab5833c0ec4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:26.766359 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-56a23f17-6092-4d5e-b518-7ab5833c0ec4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:26.773391 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56a23f17-6092-4d5e-b518-7ab5833c0ec4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:26.773879 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56a23f17-6092-4d5e-b518-7ab5833c0ec4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:26.774317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56a23f17-6092-4d5e-b518-7ab5833c0ec4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:26.775006 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56a23f17-6092-4d5e-b518-7ab5833c0ec4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:26.775488 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56a23f17-6092-4d5e-b518-7ab5833c0ec4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:26.775917 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-56a23f17-6092-4d5e-b518-7ab5833c0ec4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:26.908713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-56a23f17-6092-4d5e-b518-7ab5833c0ec4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:23:26.916794 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-56a23f17-6092-4d5e-b518-7ab5833c0ec4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:23:26.918237 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-56a23f17-6092-4d5e-b518-7ab5833c0ec4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:23:26.919436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-56a23f17-6092-4d5e-b518-7ab5833c0ec4 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1724 microversion: 2.20 time: 0.158107 Sep 09 13:23:26.920005 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 550/1105] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:23:26 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:23:27.801376 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-db35e52f-b06e-42cf-abfd-538aa3189659 req-367dbadc-f8a0-4b2b-ba7b-0b2af285386c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bed376-e738-4913-8eea-71014b54ed1f", "name": "network-vif-deleted", "tag": "38c754fd-a2fb-4031-a376-b82c80b97094"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:23:27.815003 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-db35e52f-b06e-42cf-abfd-538aa3189659 req-367dbadc-f8a0-4b2b-ba7b-0b2af285386c service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:27.815513 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-db35e52f-b06e-42cf-abfd-538aa3189659 req-367dbadc-f8a0-4b2b-ba7b-0b2af285386c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:27.816111 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-db35e52f-b06e-42cf-abfd-538aa3189659 req-367dbadc-f8a0-4b2b-ba7b-0b2af285386c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:27.836204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-db35e52f-b06e-42cf-abfd-538aa3189659 req-367dbadc-f8a0-4b2b-ba7b-0b2af285386c service nova] Creating event network-vif-deleted:38c754fd-a2fb-4031-a376-b82c80b97094 for instance b2bed376-e738-4913-8eea-71014b54ed1f on hv-cinder-83124 Sep 09 13:23:27.842335 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-db35e52f-b06e-42cf-abfd-538aa3189659 req-367dbadc-f8a0-4b2b-ba7b-0b2af285386c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045669 Sep 09 13:23:27.846161 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 556/1106] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:23:27.945565 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:27.947008 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:27.953434 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:27.954252 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:27.954861 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:27.955847 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:27.956467 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:27.957388 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:28.009543 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:28.010027 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:28.010475 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:28.010934 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.objects.instance [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lazy-loading 'fault' on Instance uuid b2bed376-e738-4913-8eea-71014b54ed1f {{(pid=120623) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:23:28.065659 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:23:28.074798 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:23:28.076257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9eb6b9dc6e409a954c7993ebe5a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f354242a7b4ae4b774681eb633c2b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:23:28.077408 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-24d4bafb-a562-4f54-885a-4e7e6269a1ac tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 200 len: 1371 microversion: 2.20 time: 0.136626 Sep 09 13:23:28.078083 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 551/1107] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:23:27 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 1371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 13:23:29.104363 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1112df4e-5ff9-4ca5-a574-0b26609f8f43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:29.105005 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1112df4e-5ff9-4ca5-a574-0b26609f8f43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:29.112334 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1112df4e-5ff9-4ca5-a574-0b26609f8f43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:29.112810 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1112df4e-5ff9-4ca5-a574-0b26609f8f43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:29.113239 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1112df4e-5ff9-4ca5-a574-0b26609f8f43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:29.113920 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1112df4e-5ff9-4ca5-a574-0b26609f8f43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:29.114364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1112df4e-5ff9-4ca5-a574-0b26609f8f43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:29.114783 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1112df4e-5ff9-4ca5-a574-0b26609f8f43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:29.128608 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-1112df4e-5ff9-4ca5-a574-0b26609f8f43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] HTTP exception thrown: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1112df4e-5ff9-4ca5-a574-0b26609f8f43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Request method failure captured: Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f HTTP/1.1 Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzyuqbVZAIYx3LALMxK3qqTBAG_QaWkCxv0HvYuLxzMXc-r4JTi0LaP60g6RZWURnCyfrecXOYXASPbUSukuA49v8a5ecDvXCmNjGVaVgdgGbrYIyPMAaR-6rEUMzSzJHUb3VcuMjikme9MPNefa3WFYUOxfZDDcbJpO9fsqKknUNKE Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 92f354242a7b4ae4b774681eb633c2b2 Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:23:29.130204 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:23:29.132087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_92f354242a7b4ae4b774681eb633c2b2", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:23:29.132087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:29.132087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 92f354242a7b4ae4b774681eb633c2b2 Sep 09 13:23:29.132087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:29.132087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeShelveTestJSON-1289054398-project Sep 09 13:23:29.132087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:23:29.132087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:23:29.132087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: ca9eb6b9dc6e409a954c7993ebe5a5c3 Sep 09 13:23:29.132087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289054398-project Sep 09 13:23:29.132087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:23:29.132087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:29.132087 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': 'b2bed376-e738-4913-8eea-71014b54ed1f'} Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:23:29.133144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:29.134772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:29.136287 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1112df4e-5ff9-4ca5-a574-0b26609f8f43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Returning 404 to user: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:23:29.136287 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1112df4e-5ff9-4ca5-a574-0b26609f8f43 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 404 len: 111 microversion: 2.20 time: 0.031535 Sep 09 13:23:29.136287 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 557/1108] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:23:29 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:23:29.140375 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-37738455-e6e4-4e18-94ea-ba6bd4d9d38f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '.version_select at 0x7fd4a19db430>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:29.159357 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-37738455-e6e4-4e18-94ea-ba6bd4d9d38f tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-273150203" status: 204 len: 0 microversion: 2.20 time: 0.022664 Sep 09 13:23:29.159915 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 552/1109] 10.222.0.17 () {60 vars in 1259 bytes} [Fri Sep 9 13:23:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-273150203 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 09 13:23:30.896162 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ed2f1cb-225f-4c5c-addd-1c41d8765a58 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:30.896658 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3ed2f1cb-225f-4c5c-addd-1c41d8765a58 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:30.903139 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ed2f1cb-225f-4c5c-addd-1c41d8765a58 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:30.903617 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ed2f1cb-225f-4c5c-addd-1c41d8765a58 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:30.904047 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ed2f1cb-225f-4c5c-addd-1c41d8765a58 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:30.904761 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ed2f1cb-225f-4c5c-addd-1c41d8765a58 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:30.905212 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ed2f1cb-225f-4c5c-addd-1c41d8765a58 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:30.905639 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3ed2f1cb-225f-4c5c-addd-1c41d8765a58 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:30.919298 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-3ed2f1cb-225f-4c5c-addd-1c41d8765a58 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] HTTP exception thrown: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ed2f1cb-225f-4c5c-addd-1c41d8765a58 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Request method failure captured: Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f HTTP/1.1 Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzyuqbVZAIYx3LALMxK3qqTBAG_QaWkCxv0HvYuLxzMXc-r4JTi0LaP60g6RZWURnCyfrecXOYXASPbUSukuA49v8a5ecDvXCmNjGVaVgdgGbrYIyPMAaR-6rEUMzSzJHUb3VcuMjikme9MPNefa3WFYUOxfZDDcbJpO9fsqKknUNKE Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 92f354242a7b4ae4b774681eb633c2b2 Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:23:30.920863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:23:30.923381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_92f354242a7b4ae4b774681eb633c2b2", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:23:30.923381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:30.923381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 92f354242a7b4ae4b774681eb633c2b2 Sep 09 13:23:30.923381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:30.923381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeShelveTestJSON-1289054398-project Sep 09 13:23:30.923381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:23:30.923381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:23:30.923381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: ca9eb6b9dc6e409a954c7993ebe5a5c3 Sep 09 13:23:30.923381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289054398-project Sep 09 13:23:30.923381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:23:30.923381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:30.923381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': 'b2bed376-e738-4913-8eea-71014b54ed1f'} Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:23:30.924425 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:30.926304 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:30.927952 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3ed2f1cb-225f-4c5c-addd-1c41d8765a58 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Returning 404 to user: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:23:30.927952 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3ed2f1cb-225f-4c5c-addd-1c41d8765a58 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 404 len: 111 microversion: 2.20 time: 0.029892 Sep 09 13:23:30.927952 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 558/1110] 10.222.0.17 () {60 vars in 1280 bytes} [Fri Sep 9 13:23:30 2022] DELETE /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:23:30.932477 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bd3a75a5-506d-4cdc-a225-212fd2f98d6b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:30.933604 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-bd3a75a5-506d-4cdc-a225-212fd2f98d6b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: b2bed376-e738-4913-8eea-71014b54ed1f] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:30.945097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd3a75a5-506d-4cdc-a225-212fd2f98d6b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:30.945582 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd3a75a5-506d-4cdc-a225-212fd2f98d6b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:30.946016 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd3a75a5-506d-4cdc-a225-212fd2f98d6b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:30.946707 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd3a75a5-506d-4cdc-a225-212fd2f98d6b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:30.947185 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd3a75a5-506d-4cdc-a225-212fd2f98d6b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:30.947610 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-bd3a75a5-506d-4cdc-a225-212fd2f98d6b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:30.960566 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-bd3a75a5-506d-4cdc-a225-212fd2f98d6b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] HTTP exception thrown: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bd3a75a5-506d-4cdc-a225-212fd2f98d6b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Request method failure captured: Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f HTTP/1.1 Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzyuqbVZAIYx3LALMxK3qqTBAG_QaWkCxv0HvYuLxzMXc-r4JTi0LaP60g6RZWURnCyfrecXOYXASPbUSukuA49v8a5ecDvXCmNjGVaVgdgGbrYIyPMAaR-6rEUMzSzJHUb3VcuMjikme9MPNefa3WFYUOxfZDDcbJpO9fsqKknUNKE Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 92f354242a7b4ae4b774681eb633c2b2 Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:23:30.962229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:23:30.964017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_92f354242a7b4ae4b774681eb633c2b2", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:23:30.964017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:30.964017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 92f354242a7b4ae4b774681eb633c2b2 Sep 09 13:23:30.964017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:30.964017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeShelveTestJSON-1289054398-project Sep 09 13:23:30.964017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:23:30.964017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:23:30.964017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: ca9eb6b9dc6e409a954c7993ebe5a5c3 Sep 09 13:23:30.964017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289054398-project Sep 09 13:23:30.964017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:23:30.964017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:30.964017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'b2bed376-e738-4913-8eea-71014b54ed1f'} Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:23:30.965138 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. Sep 09 13:23:30.966694 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:23:30.968205 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-bd3a75a5-506d-4cdc-a225-212fd2f98d6b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Returning 404 to user: Instance b2bed376-e738-4913-8eea-71014b54ed1f could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:23:30.968205 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-bd3a75a5-506d-4cdc-a225-212fd2f98d6b tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f" status: 404 len: 111 microversion: 2.20 time: 0.036101 Sep 09 13:23:30.968205 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 553/1111] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:23:30 2022] GET /compute/v2.1/servers/b2bed376-e738-4913-8eea-71014b54ed1f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:23:32.103603 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a364a1cf-9dd4-4b92-900f-24d4efcf22c2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:32.104107 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a364a1cf-9dd4-4b92-900f-24d4efcf22c2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:32.110561 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a364a1cf-9dd4-4b92-900f-24d4efcf22c2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:32.111040 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a364a1cf-9dd4-4b92-900f-24d4efcf22c2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:32.111510 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a364a1cf-9dd4-4b92-900f-24d4efcf22c2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:32.112201 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a364a1cf-9dd4-4b92-900f-24d4efcf22c2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:32.112651 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a364a1cf-9dd4-4b92-900f-24d4efcf22c2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:32.113076 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a364a1cf-9dd4-4b92-900f-24d4efcf22c2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:32.126731 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-a364a1cf-9dd4-4b92-900f-24d4efcf22c2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] HTTP exception thrown: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a364a1cf-9dd4-4b92-900f-24d4efcf22c2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Request method failure captured: Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 HTTP/1.1 Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGzyuqbVZAIYx3LALMxK3qqTBAG_QaWkCxv0HvYuLxzMXc-r4JTi0LaP60g6RZWURnCyfrecXOYXASPbUSukuA49v8a5ecDvXCmNjGVaVgdgGbrYIyPMAaR-6rEUMzSzJHUb3VcuMjikme9MPNefa3WFYUOxfZDDcbJpO9fsqKknUNKE Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 92f354242a7b4ae4b774681eb633c2b2 Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:23:32.128274 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:23:32.129994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_92f354242a7b4ae4b774681eb633c2b2", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:23:32.129994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:32.129994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 92f354242a7b4ae4b774681eb633c2b2 Sep 09 13:23:32.129994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:32.129994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-AttachVolumeShelveTestJSON-1289054398-project Sep 09 13:23:32.129994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:23:32.129994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:23:32.129994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: ca9eb6b9dc6e409a954c7993ebe5a5c3 Sep 09 13:23:32.129994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289054398-project Sep 09 13:23:32.129994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:23:32.129994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:23:32.129994 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '9f961e5a-6c12-48b6-ae52-e61b993275b3'} Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:23:32.130893 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:23:32.132476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:32.134071 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a364a1cf-9dd4-4b92-900f-24d4efcf22c2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Returning 404 to user: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:23:32.134071 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a364a1cf-9dd4-4b92-900f-24d4efcf22c2 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 404 len: 111 microversion: 2.20 time: 0.029924 Sep 09 13:23:32.134071 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 559/1112] 10.222.0.17 () {60 vars in 1280 bytes} [Fri Sep 9 13:23:32 2022] DELETE /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:23:32.138129 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-548b50f4-ea55-4406-bf83-013cb5fde0f9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:32.138743 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-548b50f4-ea55-4406-bf83-013cb5fde0f9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] [instance: 9f961e5a-6c12-48b6-ae52-e61b993275b3] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:32.146087 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-548b50f4-ea55-4406-bf83-013cb5fde0f9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:32.146578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-548b50f4-ea55-4406-bf83-013cb5fde0f9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:32.147017 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-548b50f4-ea55-4406-bf83-013cb5fde0f9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:32.147751 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-548b50f4-ea55-4406-bf83-013cb5fde0f9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:32.148213 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-548b50f4-ea55-4406-bf83-013cb5fde0f9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:32.148787 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-548b50f4-ea55-4406-bf83-013cb5fde0f9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:32.162916 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-548b50f4-ea55-4406-bf83-013cb5fde0f9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] HTTP exception thrown: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-548b50f4-ea55-4406-bf83-013cb5fde0f9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Request method failure captured: Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 HTTP/1.1 Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGzyuqbVZAIYx3LALMxK3qqTBAG_QaWkCxv0HvYuLxzMXc-r4JTi0LaP60g6RZWURnCyfrecXOYXASPbUSukuA49v8a5ecDvXCmNjGVaVgdgGbrYIyPMAaR-6rEUMzSzJHUb3VcuMjikme9MPNefa3WFYUOxfZDDcbJpO9fsqKknUNKE Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: 92f354242a7b4ae4b774681eb633c2b2 Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:23:32.164493 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:23:32.166262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/92f354242a7b4ae4b774681eb633c2b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_92f354242a7b4ae4b774681eb633c2b2", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:23:32.166262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:32.166262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: 92f354242a7b4ae4b774681eb633c2b2 Sep 09 13:23:32.166262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1289054398 Sep 09 13:23:32.166262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-AttachVolumeShelveTestJSON-1289054398-project Sep 09 13:23:32.166262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:23:32.166262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:23:32.166262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: ca9eb6b9dc6e409a954c7993ebe5a5c3 Sep 09 13:23:32.166262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1289054398-project Sep 09 13:23:32.166262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:23:32.166262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:23:32.166262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '9f961e5a-6c12-48b6-ae52-e61b993275b3'} Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:23:32.170469 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. Sep 09 13:23:32.172257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:23:32.174222 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-548b50f4-ea55-4406-bf83-013cb5fde0f9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] Returning 404 to user: Instance 9f961e5a-6c12-48b6-ae52-e61b993275b3 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:23:32.174222 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-548b50f4-ea55-4406-bf83-013cb5fde0f9 tempest-AttachVolumeShelveTestJSON-1289054398 tempest-AttachVolumeShelveTestJSON-1289054398-project] 10.222.0.17 "GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3" status: 404 len: 111 microversion: 2.20 time: 0.031671 Sep 09 13:23:32.174222 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 554/1113] 10.222.0.17 () {60 vars in 1277 bytes} [Fri Sep 9 13:23:32 2022] GET /compute/v2.1/servers/9f961e5a-6c12-48b6-ae52-e61b993275b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 13:23:37.845642 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-44332567-3040-4413-8b27-a8bdfe73e639 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] Calling method '.version_select at 0x7fd4a19f00d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:37.893068 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-44332567-3040-4413-8b27-a8bdfe73e639 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/01add72b-ffea-4759-825e-4916bbfc3cf2" status: 200 len: 350 microversion: 2.1 time: 0.051764 Sep 09 13:23:37.893656 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 560/1114] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:23:37 2022] GET /compute/v2.1/os-volumes/01add72b-ffea-4759-825e-4916bbfc3cf2 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:23:39.226503 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7ec18866-507e-4c90-9733-a2838298b795 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] Calling method '.version_select at 0x7fd4a19ea5e0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:39.274378 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7ec18866-507e-4c90-9733-a2838298b795 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/64ed6baa-0cc8-492b-9cfa-05a141751d35" status: 200 len: 350 microversion: 2.1 time: 0.051647 Sep 09 13:23:39.274938 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 555/1115] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:23:39 2022] GET /compute/v2.1/os-volumes/64ed6baa-0cc8-492b-9cfa-05a141751d35 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:23:40.608318 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5dad9f4a-3622-452d-8a24-b6ca1ce8ab54 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] Calling method '.version_select at 0x7fd4a19f2160>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:40.658550 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5dad9f4a-3622-452d-8a24-b6ca1ce8ab54 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/218fa04f-3d64-4ec0-83b6-5fdef036805d" status: 200 len: 351 microversion: 2.1 time: 0.054451 Sep 09 13:23:40.659151 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 561/1116] 10.222.0.17 () {58 vars in 1245 bytes} [Fri Sep 9 13:23:40 2022] GET /compute/v2.1/os-volumes/218fa04f-3d64-4ec0-83b6-5fdef036805d => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:23:40.672267 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0a4cdf95-e233-4927-82c6-17b10a2203ef tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] Calling method '.version_select at 0x7fd4a19370d0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:40.758412 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0a4cdf95-e233-4927-82c6-17b10a2203ef tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090165 Sep 09 13:23:40.759004 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 556/1117] 10.222.0.17 () {58 vars in 1134 bytes} [Fri Sep 9 13:23:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:23:40.773555 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c9e4825e-4742-40a2-a3ac-de64e5d885e0 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] Calling method '.version_select at 0x7fd4a19850d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:40.856193 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c9e4825e-4742-40a2-a3ac-de64e5d885e0 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086324 Sep 09 13:23:40.856756 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 562/1118] 10.222.0.17 () {58 vars in 1149 bytes} [Fri Sep 9 13:23:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:23:40.870940 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1cfbe505-60ad-45b7-8f46-6ca76fa14493 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] Calling method '.version_select at 0x7fd4a19eaee0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:40.952372 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1cfbe505-60ad-45b7-8f46-6ca76fa14493 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085124 Sep 09 13:23:40.952944 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 557/1119] 10.222.0.17 () {58 vars in 1134 bytes} [Fri Sep 9 13:23:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:23:40.966023 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-53b21958-7934-4b6b-931c-bc11c574c653 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] Calling method '.version_select at 0x7fd4a30879d0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:41.050338 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-53b21958-7934-4b6b-931c-bc11c574c653 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087989 Sep 09 13:23:41.050913 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 563/1120] 10.222.0.17 () {58 vars in 1167 bytes} [Fri Sep 9 13:23:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:23:41.064408 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-7c42022f-a4c3-458a-a962-cfeb096b6215 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] Calling method '.version_select at 0x7fd4a1937e50>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:41.147042 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-7c42022f-a4c3-458a-a962-cfeb096b6215 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086287 Sep 09 13:23:41.147648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 558/1121] 10.222.0.17 () {58 vars in 1170 bytes} [Fri Sep 9 13:23:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:23:41.162289 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-20a832fb-ee69-4c11-a485-5796d9440b69 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] Calling method '.version_select at 0x7fd4a19853a0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:41.245725 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-20a832fb-ee69-4c11-a485-5796d9440b69 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087471 Sep 09 13:23:41.246303 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 564/1122] 10.222.0.17 () {58 vars in 1155 bytes} [Fri Sep 9 13:23:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:23:41.260796 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1894de5f-6426-4b8a-800e-1a76bcdcc18c tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] Calling method '.version_select at 0x7fd4a19620d0>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:41.346109 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1894de5f-6426-4b8a-800e-1a76bcdcc18c tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089107 Sep 09 13:23:41.346676 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 559/1123] 10.222.0.17 () {58 vars in 1188 bytes} [Fri Sep 9 13:23:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:23:41.359753 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e231717f-4310-410d-bc92-83f638a51968 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] Calling method '.version_select at 0x7fd4a1d50ca0>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:41.443227 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e231717f-4310-410d-bc92-83f638a51968 tempest-VolumesTestJSON-974301506 tempest-VolumesTestJSON-974301506-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087182 Sep 09 13:23:41.443786 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 565/1124] 10.222.0.17 () {58 vars in 1155 bytes} [Fri Sep 9 13:23:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:23:41.957598 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-db1775ce-670c-47de-8e5a-7ccab64a7680 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:41.958658 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-db1775ce-670c-47de-8e5a-7ccab64a7680 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:41.960041 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-0e0e464e-d94e-46f7-96dc-c12f875fc7d4 req-e565af59-9232-4205-b037-4fe6f47d2db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76473280-a8d1-4fed-a202-c9825247c44b", "tag": "48049b9e-9115-47c4-97e1-b44a8a86aef3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:23:41.964904 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db1775ce-670c-47de-8e5a-7ccab64a7680 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:41.965514 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db1775ce-670c-47de-8e5a-7ccab64a7680 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:41.965954 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db1775ce-670c-47de-8e5a-7ccab64a7680 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:41.966648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db1775ce-670c-47de-8e5a-7ccab64a7680 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:41.967124 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db1775ce-670c-47de-8e5a-7ccab64a7680 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:41.967552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-db1775ce-670c-47de-8e5a-7ccab64a7680 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:41.970809 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0e0e464e-d94e-46f7-96dc-c12f875fc7d4 req-e565af59-9232-4205-b037-4fe6f47d2db6 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:41.971642 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0e0e464e-d94e-46f7-96dc-c12f875fc7d4 req-e565af59-9232-4205-b037-4fe6f47d2db6 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:41.972143 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-0e0e464e-d94e-46f7-96dc-c12f875fc7d4 req-e565af59-9232-4205-b037-4fe6f47d2db6 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:41.984213 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-0e0e464e-d94e-46f7-96dc-c12f875fc7d4 req-e565af59-9232-4205-b037-4fe6f47d2db6 service nova] Creating event network-changed:48049b9e-9115-47c4-97e1-b44a8a86aef3 for instance 76473280-a8d1-4fed-a202-c9825247c44b on hv-cinder-83124 Sep 09 13:23:41.990130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-0e0e464e-d94e-46f7-96dc-c12f875fc7d4 req-e565af59-9232-4205-b037-4fe6f47d2db6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034385 Sep 09 13:23:41.990734 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 566/1125] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 13:23:41.995699 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-db1775ce-670c-47de-8e5a-7ccab64a7680 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:23:42.084609 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-db1775ce-670c-47de-8e5a-7ccab64a7680 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "DELETE /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 204 len: 0 microversion: 2.1 time: 0.131893 Sep 09 13:23:42.085547 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 560/1126] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:23:41 2022] DELETE /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:23:42.095522 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d1d3c3b4-5e9f-4e09-bafc-d2f39b6f1a04 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:42.096742 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d1d3c3b4-5e9f-4e09-bafc-d2f39b6f1a04 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:42.103285 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1d3c3b4-5e9f-4e09-bafc-d2f39b6f1a04 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:42.103776 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1d3c3b4-5e9f-4e09-bafc-d2f39b6f1a04 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:42.104210 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1d3c3b4-5e9f-4e09-bafc-d2f39b6f1a04 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:42.104907 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1d3c3b4-5e9f-4e09-bafc-d2f39b6f1a04 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:42.105361 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1d3c3b4-5e9f-4e09-bafc-d2f39b6f1a04 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:42.105962 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d1d3c3b4-5e9f-4e09-bafc-d2f39b6f1a04 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:42.271024 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d1d3c3b4-5e9f-4e09-bafc-d2f39b6f1a04 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:23:42.278920 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d1d3c3b4-5e9f-4e09-bafc-d2f39b6f1a04 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1569 microversion: 2.1 time: 0.188536 Sep 09 13:23:42.279512 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 567/1127] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:23:42 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:23:43.302658 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-15342bfe-d0c4-463e-9f56-d9c59436c75d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:43.303384 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-15342bfe-d0c4-463e-9f56-d9c59436c75d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:43.309854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-15342bfe-d0c4-463e-9f56-d9c59436c75d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:43.310336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-15342bfe-d0c4-463e-9f56-d9c59436c75d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:43.310771 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-15342bfe-d0c4-463e-9f56-d9c59436c75d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:43.311507 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-15342bfe-d0c4-463e-9f56-d9c59436c75d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:43.311961 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-15342bfe-d0c4-463e-9f56-d9c59436c75d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:43.312383 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-15342bfe-d0c4-463e-9f56-d9c59436c75d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:43.478648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-15342bfe-d0c4-463e-9f56-d9c59436c75d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:23:43.486935 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-15342bfe-d0c4-463e-9f56-d9c59436c75d tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1569 microversion: 2.1 time: 0.188489 Sep 09 13:23:43.487559 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 561/1128] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:23:43 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:23:44.375361 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-23424f9b-6597-413f-9d59-72e6624ced28 req-02e7db14-e8ff-4f0b-aa4a-6cbacf0731aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76473280-a8d1-4fed-a202-c9825247c44b", "name": "network-vif-deleted", "tag": "48049b9e-9115-47c4-97e1-b44a8a86aef3"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:23:44.388013 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-23424f9b-6597-413f-9d59-72e6624ced28 req-02e7db14-e8ff-4f0b-aa4a-6cbacf0731aa service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:44.389072 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-23424f9b-6597-413f-9d59-72e6624ced28 req-02e7db14-e8ff-4f0b-aa4a-6cbacf0731aa service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:44.389664 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-23424f9b-6597-413f-9d59-72e6624ced28 req-02e7db14-e8ff-4f0b-aa4a-6cbacf0731aa service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:44.403131 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-23424f9b-6597-413f-9d59-72e6624ced28 req-02e7db14-e8ff-4f0b-aa4a-6cbacf0731aa service nova] Creating event network-vif-deleted:48049b9e-9115-47c4-97e1-b44a8a86aef3 for instance 76473280-a8d1-4fed-a202-c9825247c44b on hv-cinder-83124 Sep 09 13:23:44.408576 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-23424f9b-6597-413f-9d59-72e6624ced28 req-02e7db14-e8ff-4f0b-aa4a-6cbacf0731aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037002 Sep 09 13:23:44.409158 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 568/1129] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:23:44.510765 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-38f90ff8-87a1-48aa-be8c-f785bd2e1253 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:44.511396 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-38f90ff8-87a1-48aa-be8c-f785bd2e1253 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:44.517983 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38f90ff8-87a1-48aa-be8c-f785bd2e1253 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:44.518467 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38f90ff8-87a1-48aa-be8c-f785bd2e1253 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:44.518905 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38f90ff8-87a1-48aa-be8c-f785bd2e1253 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:44.519633 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38f90ff8-87a1-48aa-be8c-f785bd2e1253 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:44.520090 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38f90ff8-87a1-48aa-be8c-f785bd2e1253 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:44.520513 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-38f90ff8-87a1-48aa-be8c-f785bd2e1253 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:44.586805 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-38f90ff8-87a1-48aa-be8c-f785bd2e1253 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3edc8b9046ac4112a838a9c3b39aecf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8da7b799a4bf49ce080e37a36c1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:23:44.595705 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-38f90ff8-87a1-48aa-be8c-f785bd2e1253 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 200 len: 1220 microversion: 2.1 time: 0.088503 Sep 09 13:23:44.596427 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 562/1130] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:23:44 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:23:45.619858 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9d76a6f-7971-44b5-9437-9b2ba4871a76 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:45.620585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a9d76a6f-7971-44b5-9437-9b2ba4871a76 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] [instance: 76473280-a8d1-4fed-a202-c9825247c44b] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:23:45.627094 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9d76a6f-7971-44b5-9437-9b2ba4871a76 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:45.627549 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9d76a6f-7971-44b5-9437-9b2ba4871a76 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:45.627978 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9d76a6f-7971-44b5-9437-9b2ba4871a76 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:45.628665 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9d76a6f-7971-44b5-9437-9b2ba4871a76 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:23:45.629111 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9d76a6f-7971-44b5-9437-9b2ba4871a76 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:23:45.629528 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a9d76a6f-7971-44b5-9437-9b2ba4871a76 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:23:45.643257 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-a9d76a6f-7971-44b5-9437-9b2ba4871a76 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] HTTP exception thrown: Instance 76473280-a8d1-4fed-a202-c9825247c44b could not be found. Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9d76a6f-7971-44b5-9437-9b2ba4871a76 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Request method failure captured: Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b HTTP/1.1 Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGz0WI6q6scw-JHwlvkOB_77mzgs7CKlldICAs2u1LJX6oEoI9jArfcSz12dALiTMlRr1EXHi0j4yfjrRrvon3qX0bS6oNvTg36z-ETqXlyS2QtaH0s8dTCGqZCKFTlPIvm6VvgFhd8bQ0_SUx0FIf35gmV_xopZ5WMVr5dr_zLwyiXU Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 4cc8da7b799a4bf49ce080e37a36c1d0 Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-TestShelveInstance-1992476808 Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:23:45.644942 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:23:45.646695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4cc8da7b799a4bf49ce080e37a36c1d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4cc8da7b799a4bf49ce080e37a36c1d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4cc8da7b799a4bf49ce080e37a36c1d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4cc8da7b799a4bf49ce080e37a36c1d0", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:23:45.646695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-TestShelveInstance-1992476808 Sep 09 13:23:45.646695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 4cc8da7b799a4bf49ce080e37a36c1d0 Sep 09 13:23:45.646695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestShelveInstance-1992476808 Sep 09 13:23:45.646695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-TestShelveInstance-1992476808-project Sep 09 13:23:45.646695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:23:45.646695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:23:45.646695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: 3edc8b9046ac4112a838a9c3b39aecf0 Sep 09 13:23:45.646695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-TestShelveInstance-1992476808-project Sep 09 13:23:45.646695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:23:45.646695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 76473280-a8d1-4fed-a202-c9825247c44b could not be found. Sep 09 13:23:45.646695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '76473280-a8d1-4fed-a202-c9825247c44b'} Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76473280-a8d1-4fed-a202-c9825247c44b could not be found. Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:23:45.647832 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76473280-a8d1-4fed-a202-c9825247c44b could not be found. Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76473280-a8d1-4fed-a202-c9825247c44b could not be found. Sep 09 13:23:45.649449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:23:45.650848 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a9d76a6f-7971-44b5-9437-9b2ba4871a76 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Returning 404 to user: Instance 76473280-a8d1-4fed-a202-c9825247c44b could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:23:45.650848 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a9d76a6f-7971-44b5-9437-9b2ba4871a76 tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b" status: 404 len: 111 microversion: 2.1 time: 0.031269 Sep 09 13:23:45.650848 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 569/1131] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:23:45 2022] GET /compute/v2.1/servers/76473280-a8d1-4fed-a202-c9825247c44b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:23:45.819595 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-1ae4c7af-173b-4e0a-8409-76786d1f82fe tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] Calling method '.version_select at 0x7fd4a19ea040>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:23:45.845741 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-1ae4c7af-173b-4e0a-8409-76786d1f82fe tempest-TestShelveInstance-1992476808 tempest-TestShelveInstance-1992476808-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1196201159" status: 202 len: 0 microversion: 2.1 time: 0.028501 Sep 09 13:23:45.847384 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 563/1132] 10.222.0.17 () {58 vars in 1254 bytes} [Fri Sep 9 13:23:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1196201159 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 13:24:00.815315 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1562041955", "imageRef": "7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4", "flavorRef": "452"}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:24:00.822505 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=20 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:00.823172 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=32 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:00.869628 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] validate_networks() for None {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:24:01.138210 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:24:01.138640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:24:01.139167 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:24:01.139577 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:24:01.139991 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:24:01.148702 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:01.149193 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:01.149627 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:01.150355 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:01.150812 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:01.151272 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:01.167926 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Getting quotas for project 658e8f7418634b188c28aae0981c02d8. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:24:01.171857 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Getting quotas for user 77e2098718c04d80a99d4be1d6693e86 and project 658e8f7418634b188c28aae0981c02d8. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:24:01.183130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:24:01.185390 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7c7dc7e3-a63c-48d5-bab6-0c68c1991ec4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:24:01.230554 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e41c841a-81d6-483b-aba7-8ce8e7af16ef tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.420192 Sep 09 13:24:01.231349 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 570/1133] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:24:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:24:01.243219 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-10835f9a-b5b5-477a-b223-8d842b50d897 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:01.243862 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-10835f9a-b5b5-477a-b223-8d842b50d897 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:01.246427 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:01.247086 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:01.306378 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-10835f9a-b5b5-477a-b223-8d842b50d897 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e2098718c04d80a99d4be1d6693e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658e8f7418634b188c28aae0981c02d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:01.313137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-10835f9a-b5b5-477a-b223-8d842b50d897 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] 10.222.0.17 "GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611" status: 200 len: 1215 microversion: 2.1 time: 0.073867 Sep 09 13:24:01.313823 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 564/1134] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:01 2022] GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:02.337036 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e443540f-8899-4dc2-bc64-784e191736d1 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:02.337663 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e443540f-8899-4dc2-bc64-784e191736d1 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:02.345542 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e443540f-8899-4dc2-bc64-784e191736d1 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:02.346030 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e443540f-8899-4dc2-bc64-784e191736d1 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:02.346465 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e443540f-8899-4dc2-bc64-784e191736d1 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:02.347200 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e443540f-8899-4dc2-bc64-784e191736d1 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:02.347653 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e443540f-8899-4dc2-bc64-784e191736d1 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:02.348075 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e443540f-8899-4dc2-bc64-784e191736d1 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:02.443840 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e443540f-8899-4dc2-bc64-784e191736d1 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e2098718c04d80a99d4be1d6693e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658e8f7418634b188c28aae0981c02d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:02.451390 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e443540f-8899-4dc2-bc64-784e191736d1 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] 10.222.0.17 "GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611" status: 200 len: 1273 microversion: 2.1 time: 0.119078 Sep 09 13:24:02.451959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 571/1135] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:02 2022] GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611 => generated 1273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:03.475802 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-b640c923-1fc1-4415-91eb-59e2dc1dcc56 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:03.476414 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-b640c923-1fc1-4415-91eb-59e2dc1dcc56 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:03.483282 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b640c923-1fc1-4415-91eb-59e2dc1dcc56 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:03.483775 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b640c923-1fc1-4415-91eb-59e2dc1dcc56 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:03.484217 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b640c923-1fc1-4415-91eb-59e2dc1dcc56 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:03.485565 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b640c923-1fc1-4415-91eb-59e2dc1dcc56 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:03.486014 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b640c923-1fc1-4415-91eb-59e2dc1dcc56 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:03.486445 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-b640c923-1fc1-4415-91eb-59e2dc1dcc56 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:03.619410 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-b640c923-1fc1-4415-91eb-59e2dc1dcc56 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e2098718c04d80a99d4be1d6693e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658e8f7418634b188c28aae0981c02d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:03.628175 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-b640c923-1fc1-4415-91eb-59e2dc1dcc56 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] 10.222.0.17 "GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611" status: 200 len: 1315 microversion: 2.1 time: 0.156144 Sep 09 13:24:03.628892 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 565/1136] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:03 2022] GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:24:03.691072 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-06941370-292b-4588-a243-ca1972bd5565 req-0b191e32-c67d-4e0c-a4a6-00179e93ba92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "532ca97c-524c-42c2-8d00-aa469d3ca611", "tag": "3296c37e-114b-408d-bc66-49236aa5c9c4"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:24:03.704277 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-06941370-292b-4588-a243-ca1972bd5565 req-0b191e32-c67d-4e0c-a4a6-00179e93ba92 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:03.705158 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-06941370-292b-4588-a243-ca1972bd5565 req-0b191e32-c67d-4e0c-a4a6-00179e93ba92 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:03.705672 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-06941370-292b-4588-a243-ca1972bd5565 req-0b191e32-c67d-4e0c-a4a6-00179e93ba92 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:03.717455 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-06941370-292b-4588-a243-ca1972bd5565 req-0b191e32-c67d-4e0c-a4a6-00179e93ba92 service nova] Creating event network-changed:3296c37e-114b-408d-bc66-49236aa5c9c4 for instance 532ca97c-524c-42c2-8d00-aa469d3ca611 on hv-cinder-83124 Sep 09 13:24:03.723014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-06941370-292b-4588-a243-ca1972bd5565 req-0b191e32-c67d-4e0c-a4a6-00179e93ba92 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036775 Sep 09 13:24:03.723644 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 572/1137] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:24:04.652275 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-92e7c8cb-27d1-4802-aad8-501c1d32ee5c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:04.652906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-92e7c8cb-27d1-4802-aad8-501c1d32ee5c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:04.660230 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92e7c8cb-27d1-4802-aad8-501c1d32ee5c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:04.660711 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92e7c8cb-27d1-4802-aad8-501c1d32ee5c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:04.661137 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92e7c8cb-27d1-4802-aad8-501c1d32ee5c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:04.661819 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92e7c8cb-27d1-4802-aad8-501c1d32ee5c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:04.662269 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92e7c8cb-27d1-4802-aad8-501c1d32ee5c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:04.662690 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-92e7c8cb-27d1-4802-aad8-501c1d32ee5c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:04.797871 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-92e7c8cb-27d1-4802-aad8-501c1d32ee5c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e2098718c04d80a99d4be1d6693e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658e8f7418634b188c28aae0981c02d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:04.805678 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-92e7c8cb-27d1-4802-aad8-501c1d32ee5c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] 10.222.0.17 "GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611" status: 200 len: 1315 microversion: 2.1 time: 0.157174 Sep 09 13:24:04.806255 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 566/1138] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:04 2022] GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:05.830468 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d866edae-6aa0-4c76-82ab-fc8c3bc31bf8 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:05.831196 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d866edae-6aa0-4c76-82ab-fc8c3bc31bf8 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:05.837256 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d866edae-6aa0-4c76-82ab-fc8c3bc31bf8 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:05.837727 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d866edae-6aa0-4c76-82ab-fc8c3bc31bf8 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:05.838152 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d866edae-6aa0-4c76-82ab-fc8c3bc31bf8 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:05.838828 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d866edae-6aa0-4c76-82ab-fc8c3bc31bf8 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:05.839301 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d866edae-6aa0-4c76-82ab-fc8c3bc31bf8 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:05.839721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d866edae-6aa0-4c76-82ab-fc8c3bc31bf8 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:05.971604 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d866edae-6aa0-4c76-82ab-fc8c3bc31bf8 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e2098718c04d80a99d4be1d6693e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658e8f7418634b188c28aae0981c02d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:05.979027 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d866edae-6aa0-4c76-82ab-fc8c3bc31bf8 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] 10.222.0.17 "GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611" status: 200 len: 1315 microversion: 2.1 time: 0.153945 Sep 09 13:24:05.979636 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 573/1139] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:05 2022] GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:07.001931 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-02ec20c3-6036-46e3-946b-3918f422e086 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:07.002548 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-02ec20c3-6036-46e3-946b-3918f422e086 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:07.009245 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02ec20c3-6036-46e3-946b-3918f422e086 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:07.009737 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02ec20c3-6036-46e3-946b-3918f422e086 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:07.010175 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02ec20c3-6036-46e3-946b-3918f422e086 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:07.010872 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02ec20c3-6036-46e3-946b-3918f422e086 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:07.011361 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02ec20c3-6036-46e3-946b-3918f422e086 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:07.011795 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-02ec20c3-6036-46e3-946b-3918f422e086 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:07.140491 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-02ec20c3-6036-46e3-946b-3918f422e086 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e2098718c04d80a99d4be1d6693e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658e8f7418634b188c28aae0981c02d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:07.148154 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-02ec20c3-6036-46e3-946b-3918f422e086 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] 10.222.0.17 "GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611" status: 200 len: 1315 microversion: 2.1 time: 0.150719 Sep 09 13:24:07.148712 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 567/1140] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:06 2022] GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:08.171265 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-64efd0fd-e480-41ad-8f13-2e06e6df74d6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:08.171794 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-64efd0fd-e480-41ad-8f13-2e06e6df74d6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:08.178858 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64efd0fd-e480-41ad-8f13-2e06e6df74d6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:08.179433 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64efd0fd-e480-41ad-8f13-2e06e6df74d6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:08.179866 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64efd0fd-e480-41ad-8f13-2e06e6df74d6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:08.180549 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64efd0fd-e480-41ad-8f13-2e06e6df74d6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:08.181002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64efd0fd-e480-41ad-8f13-2e06e6df74d6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:08.181419 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-64efd0fd-e480-41ad-8f13-2e06e6df74d6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:08.307966 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-64efd0fd-e480-41ad-8f13-2e06e6df74d6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e2098718c04d80a99d4be1d6693e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658e8f7418634b188c28aae0981c02d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:08.316166 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-64efd0fd-e480-41ad-8f13-2e06e6df74d6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] 10.222.0.17 "GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611" status: 200 len: 1315 microversion: 2.1 time: 0.148833 Sep 09 13:24:08.316706 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 574/1141] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:08 2022] GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:08.539081 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-6e15ee8e-3425-440e-97b5-b000e1b10b71 req-240c6d73-a40e-4ea2-909a-e0fcd73c52c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532ca97c-524c-42c2-8d00-aa469d3ca611", "name": "network-vif-plugged", "status": "completed", "tag": "3296c37e-114b-408d-bc66-49236aa5c9c4"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:24:08.552221 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6e15ee8e-3425-440e-97b5-b000e1b10b71 req-240c6d73-a40e-4ea2-909a-e0fcd73c52c3 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:08.552703 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6e15ee8e-3425-440e-97b5-b000e1b10b71 req-240c6d73-a40e-4ea2-909a-e0fcd73c52c3 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:08.553132 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6e15ee8e-3425-440e-97b5-b000e1b10b71 req-240c6d73-a40e-4ea2-909a-e0fcd73c52c3 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:08.564169 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-6e15ee8e-3425-440e-97b5-b000e1b10b71 req-240c6d73-a40e-4ea2-909a-e0fcd73c52c3 service nova] Creating event network-vif-plugged:3296c37e-114b-408d-bc66-49236aa5c9c4 for instance 532ca97c-524c-42c2-8d00-aa469d3ca611 on hv-cinder-83124 Sep 09 13:24:08.569167 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-6e15ee8e-3425-440e-97b5-b000e1b10b71 req-240c6d73-a40e-4ea2-909a-e0fcd73c52c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033986 Sep 09 13:24:08.569959 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 568/1142] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:24:09.339034 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-6ee03774-dd58-40e3-bb94-c8b95eb2a4ec tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:09.339657 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-6ee03774-dd58-40e3-bb94-c8b95eb2a4ec tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:09.346580 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee03774-dd58-40e3-bb94-c8b95eb2a4ec tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:09.347074 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee03774-dd58-40e3-bb94-c8b95eb2a4ec tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:09.347566 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee03774-dd58-40e3-bb94-c8b95eb2a4ec tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:09.348285 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee03774-dd58-40e3-bb94-c8b95eb2a4ec tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:09.348737 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee03774-dd58-40e3-bb94-c8b95eb2a4ec tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:09.349175 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-6ee03774-dd58-40e3-bb94-c8b95eb2a4ec tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:09.477699 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-6ee03774-dd58-40e3-bb94-c8b95eb2a4ec tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e2098718c04d80a99d4be1d6693e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658e8f7418634b188c28aae0981c02d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:09.485749 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-6ee03774-dd58-40e3-bb94-c8b95eb2a4ec tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] 10.222.0.17 "GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611" status: 200 len: 1315 microversion: 2.1 time: 0.150590 Sep 09 13:24:09.486301 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 575/1143] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:09 2022] GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:10.509097 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-24a1b2ad-e264-461f-b669-690a06dc31e6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:10.509794 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-24a1b2ad-e264-461f-b669-690a06dc31e6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:10.516381 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24a1b2ad-e264-461f-b669-690a06dc31e6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:10.516878 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24a1b2ad-e264-461f-b669-690a06dc31e6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:10.517302 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24a1b2ad-e264-461f-b669-690a06dc31e6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:10.518009 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24a1b2ad-e264-461f-b669-690a06dc31e6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:10.518501 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24a1b2ad-e264-461f-b669-690a06dc31e6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:10.519545 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-24a1b2ad-e264-461f-b669-690a06dc31e6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:10.656818 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-24a1b2ad-e264-461f-b669-690a06dc31e6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e2098718c04d80a99d4be1d6693e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658e8f7418634b188c28aae0981c02d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:10.664571 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-24a1b2ad-e264-461f-b669-690a06dc31e6 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] 10.222.0.17 "GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611" status: 200 len: 1464 microversion: 2.1 time: 0.160176 Sep 09 13:24:10.665142 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 569/1144] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:10 2022] GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611 => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:10.711960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-76b92bee-28c9-4946-8af7-f06761941c2c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:10.712462 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-76b92bee-28c9-4946-8af7-f06761941c2c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:10.718814 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76b92bee-28c9-4946-8af7-f06761941c2c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:10.719765 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76b92bee-28c9-4946-8af7-f06761941c2c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:10.720437 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76b92bee-28c9-4946-8af7-f06761941c2c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:10.721138 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76b92bee-28c9-4946-8af7-f06761941c2c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:10.721598 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76b92bee-28c9-4946-8af7-f06761941c2c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:10.722028 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-76b92bee-28c9-4946-8af7-f06761941c2c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:10.749062 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-76b92bee-28c9-4946-8af7-f06761941c2c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:24:10.824495 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-76b92bee-28c9-4946-8af7-f06761941c2c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] 10.222.0.17 "DELETE /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611" status: 204 len: 0 microversion: 2.1 time: 0.116046 Sep 09 13:24:10.825092 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 576/1145] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:24:10 2022] DELETE /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:24:10.834299 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ebd88fba-356a-4c98-ad49-98261c65c116 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:10.834916 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ebd88fba-356a-4c98-ad49-98261c65c116 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:10.840846 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ebd88fba-356a-4c98-ad49-98261c65c116 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:10.841330 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ebd88fba-356a-4c98-ad49-98261c65c116 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:10.841770 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ebd88fba-356a-4c98-ad49-98261c65c116 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:10.842452 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ebd88fba-356a-4c98-ad49-98261c65c116 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:10.842905 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ebd88fba-356a-4c98-ad49-98261c65c116 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:10.843351 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ebd88fba-356a-4c98-ad49-98261c65c116 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:10.974880 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ebd88fba-356a-4c98-ad49-98261c65c116 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e2098718c04d80a99d4be1d6693e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658e8f7418634b188c28aae0981c02d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:10.982504 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ebd88fba-356a-4c98-ad49-98261c65c116 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] 10.222.0.17 "GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611" status: 200 len: 1470 microversion: 2.1 time: 0.152134 Sep 09 13:24:10.983088 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 570/1146] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:10 2022] GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:24:12.006584 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-18653a4c-7fb9-4351-a9eb-b8dbd3a6ffd3 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:12.007322 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-18653a4c-7fb9-4351-a9eb-b8dbd3a6ffd3 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:12.009227 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:12.010045 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:12.017327 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18653a4c-7fb9-4351-a9eb-b8dbd3a6ffd3 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:12.017816 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18653a4c-7fb9-4351-a9eb-b8dbd3a6ffd3 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:12.018269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18653a4c-7fb9-4351-a9eb-b8dbd3a6ffd3 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:12.018950 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18653a4c-7fb9-4351-a9eb-b8dbd3a6ffd3 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:12.019435 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18653a4c-7fb9-4351-a9eb-b8dbd3a6ffd3 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:12.019865 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-18653a4c-7fb9-4351-a9eb-b8dbd3a6ffd3 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:12.180605 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-18653a4c-7fb9-4351-a9eb-b8dbd3a6ffd3 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77e2098718c04d80a99d4be1d6693e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '658e8f7418634b188c28aae0981c02d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:12.188968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-18653a4c-7fb9-4351-a9eb-b8dbd3a6ffd3 tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] 10.222.0.17 "GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611" status: 200 len: 1470 microversion: 2.1 time: 0.186596 Sep 09 13:24:12.189549 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 577/1147] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:12 2022] GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611 => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:12.603105 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-3a41f1b8-ef1f-4891-8350-9de9c39063b7 req-27ee0fca-31b5-4b81-b696-e829a94e5969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532ca97c-524c-42c2-8d00-aa469d3ca611", "name": "network-vif-deleted", "tag": "3296c37e-114b-408d-bc66-49236aa5c9c4"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:24:12.615103 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:12.617595 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-3a41f1b8-ef1f-4891-8350-9de9c39063b7 req-27ee0fca-31b5-4b81-b696-e829a94e5969 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:12.618140 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-3a41f1b8-ef1f-4891-8350-9de9c39063b7 req-27ee0fca-31b5-4b81-b696-e829a94e5969 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:12.618648 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-3a41f1b8-ef1f-4891-8350-9de9c39063b7 req-27ee0fca-31b5-4b81-b696-e829a94e5969 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:12.637114 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-3a41f1b8-ef1f-4891-8350-9de9c39063b7 req-27ee0fca-31b5-4b81-b696-e829a94e5969 service nova] Creating event network-vif-deleted:3296c37e-114b-408d-bc66-49236aa5c9c4 for instance 532ca97c-524c-42c2-8d00-aa469d3ca611 on hv-cinder-83124 Sep 09 13:24:12.642766 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-3a41f1b8-ef1f-4891-8350-9de9c39063b7 req-27ee0fca-31b5-4b81-b696-e829a94e5969 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043187 Sep 09 13:24:12.643724 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 571/1148] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:24:13.212285 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-736214e2-d13f-49a5-a50f-7cf9c2565a6c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:13.212892 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-736214e2-d13f-49a5-a50f-7cf9c2565a6c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] [instance: 532ca97c-524c-42c2-8d00-aa469d3ca611] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:13.219929 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-736214e2-d13f-49a5-a50f-7cf9c2565a6c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:13.220400 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-736214e2-d13f-49a5-a50f-7cf9c2565a6c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:13.220830 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-736214e2-d13f-49a5-a50f-7cf9c2565a6c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:13.221509 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-736214e2-d13f-49a5-a50f-7cf9c2565a6c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:13.221956 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-736214e2-d13f-49a5-a50f-7cf9c2565a6c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:13.222372 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-736214e2-d13f-49a5-a50f-7cf9c2565a6c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:13.235887 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-736214e2-d13f-49a5-a50f-7cf9c2565a6c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] HTTP exception thrown: Instance 532ca97c-524c-42c2-8d00-aa469d3ca611 could not be found. Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-736214e2-d13f-49a5-a50f-7cf9c2565a6c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Request method failure captured: Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611 HTTP/1.1 Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGz5vjPL4_mZq7UbEApaKOcuUE_KRG-EU4W96niE4034oaB2BRKAh5mdlW1R5C0il9iEGol9WMw61fAVbIvuet5GJqDOLLmBNkX9I2aU1sMS--xDEI24PecVhhwBA5vAmP-0_rBp_0kkHKyjVDOy9_gYgvYukdbCKbjtFpfp55L7F9VU Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: 658e8f7418634b188c28aae0981c02d8 Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-VolumesNegativeTest-1208747134 Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:24:13.237537 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:24:13.239279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/658e8f7418634b188c28aae0981c02d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/658e8f7418634b188c28aae0981c02d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/658e8f7418634b188c28aae0981c02d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_658e8f7418634b188c28aae0981c02d8", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:24:13.239279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-VolumesNegativeTest-1208747134 Sep 09 13:24:13.239279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: 658e8f7418634b188c28aae0981c02d8 Sep 09 13:24:13.239279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-VolumesNegativeTest-1208747134 Sep 09 13:24:13.239279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-VolumesNegativeTest-1208747134-project Sep 09 13:24:13.239279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:24:13.239279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:24:13.239279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: 77e2098718c04d80a99d4be1d6693e86 Sep 09 13:24:13.239279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-VolumesNegativeTest-1208747134-project Sep 09 13:24:13.239279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:24:13.239279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 532ca97c-524c-42c2-8d00-aa469d3ca611 could not be found. Sep 09 13:24:13.239279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '532ca97c-524c-42c2-8d00-aa469d3ca611'} Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532ca97c-524c-42c2-8d00-aa469d3ca611 could not be found. Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:24:13.240269 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532ca97c-524c-42c2-8d00-aa469d3ca611 could not be found. Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532ca97c-524c-42c2-8d00-aa469d3ca611 could not be found. Sep 09 13:24:13.241937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:24:13.243366 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-736214e2-d13f-49a5-a50f-7cf9c2565a6c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] Returning 404 to user: Instance 532ca97c-524c-42c2-8d00-aa469d3ca611 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:24:13.243366 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-736214e2-d13f-49a5-a50f-7cf9c2565a6c tempest-VolumesNegativeTest-1208747134 tempest-VolumesNegativeTest-1208747134-project] 10.222.0.17 "GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611" status: 404 len: 111 microversion: 2.1 time: 0.030458 Sep 09 13:24:13.243366 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 578/1149] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:13 2022] GET /compute/v2.1/servers/532ca97c-524c-42c2-8d00-aa469d3ca611 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:24:27.277485 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=18 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:27.278271 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=34 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:27.512930 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-424cb92b-5b25-4e20-b258-565f5b03eda8 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Action: 'create', calling method: .version_select at 0x7fd4a1937c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-826659176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyxXP3KaOELLQM8e0r6TSBhPKTLTfWuf34IguG7MqoaMiMT/pcw/to6ZjihmZlbAole9KuW9SNSRkin8JxQmRBI3KOHVrRCiRUYQbrspvrX9y59p6EsKSRrihGWB2fP0A=="}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:24:27.528972 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-424cb92b-5b25-4e20-b258-565f5b03eda8 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Getting quotas for project b7dd3b78c2a74ac4baa2f0bb21482ed9. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:24:27.533663 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-424cb92b-5b25-4e20-b258-565f5b03eda8 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Getting quotas for user 5ab98652cbab470b8a385fe6381dd80b and project b7dd3b78c2a74ac4baa2f0bb21482ed9. Resources: {'key_pairs'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:24:27.560665 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-424cb92b-5b25-4e20-b258-565f5b03eda8 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.284517 Sep 09 13:24:27.561326 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 572/1150] 10.222.0.17 () {60 vars in 1159 bytes} [Fri Sep 9 13:24:27 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:24:42.837597 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2053323724", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-826659176", "security_groups": [{"name": "tempest-secgroup-smoke-216769747"}], "block_device_mapping_v2": [{"uuid": "14b4dbd1-f4d5-4a7d-a972-6b50413acd84", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ec5175a-de79-45cd-b4bc-8c6a9172e979"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:24:42.848456 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:42.849127 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:43.066553 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] validate_networks() for [('5ec5175a-de79-45cd-b4bc-8c6a9172e979', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:24:43.448666 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:24:43.449114 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:24:43.449575 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:24:43.449975 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:24:43.450377 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:24:43.459755 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:43.460238 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:43.460667 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:43.461383 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:43.461829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:43.462247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:43.479302 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Getting quotas for project b7dd3b78c2a74ac4baa2f0bb21482ed9. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:24:43.483340 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Getting quotas for user 5ab98652cbab470b8a385fe6381dd80b and project b7dd3b78c2a74ac4baa2f0bb21482ed9. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:24:43.539598 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:24:43.541758 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14b4dbd1-f4d5-4a7d-a972-6b50413acd84',volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:24:43.684061 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-99ebdb5e-affc-4a22-81eb-fa4694700cfa tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.850526 Sep 09 13:24:43.684696 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 579/1151] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:24:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:24:43.693989 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=4 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:43.694743 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:43.698612 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-c0a3c472-15ec-4381-8506-26cafbf8657f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:43.699317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-c0a3c472-15ec-4381-8506-26cafbf8657f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:43.878832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-c0a3c472-15ec-4381-8506-26cafbf8657f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:43.885703 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-c0a3c472-15ec-4381-8506-26cafbf8657f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1094 microversion: 2.1 time: 0.193060 Sep 09 13:24:43.886271 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 573/1152] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:43 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1094 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:44.909710 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-91961fe2-9466-4375-80ca-d59e726a90e7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:44.910263 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-91961fe2-9466-4375-80ca-d59e726a90e7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:44.916959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91961fe2-9466-4375-80ca-d59e726a90e7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:44.917440 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91961fe2-9466-4375-80ca-d59e726a90e7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:44.917874 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91961fe2-9466-4375-80ca-d59e726a90e7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:44.918631 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91961fe2-9466-4375-80ca-d59e726a90e7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:44.919101 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91961fe2-9466-4375-80ca-d59e726a90e7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:44.919700 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-91961fe2-9466-4375-80ca-d59e726a90e7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:44.992762 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-91961fe2-9466-4375-80ca-d59e726a90e7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:45.002571 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-91961fe2-9466-4375-80ca-d59e726a90e7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1210 microversion: 2.1 time: 0.097401 Sep 09 13:24:45.003162 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 580/1153] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:44 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:46.026032 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-2a9679da-0a05-4c22-8bc4-a6ca3e125d6c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:46.026635 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-2a9679da-0a05-4c22-8bc4-a6ca3e125d6c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:46.033420 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2a9679da-0a05-4c22-8bc4-a6ca3e125d6c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:46.033906 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2a9679da-0a05-4c22-8bc4-a6ca3e125d6c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:46.034342 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2a9679da-0a05-4c22-8bc4-a6ca3e125d6c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:46.035039 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2a9679da-0a05-4c22-8bc4-a6ca3e125d6c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:46.035513 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2a9679da-0a05-4c22-8bc4-a6ca3e125d6c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:46.035943 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-2a9679da-0a05-4c22-8bc4-a6ca3e125d6c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:46.061789 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-05e43add-152f-422f-ad28-3fba0ae8ae76 req-098dd8d5-e97b-46ac-bb9a-4f6138c8b8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982c0e01-d662-4756-b9c4-4f660054ed71", "tag": "5cd649b3-0c07-4f95-a3b4-8e7e677cd269"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:24:46.074009 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-05e43add-152f-422f-ad28-3fba0ae8ae76 req-098dd8d5-e97b-46ac-bb9a-4f6138c8b8d0 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:46.074494 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-05e43add-152f-422f-ad28-3fba0ae8ae76 req-098dd8d5-e97b-46ac-bb9a-4f6138c8b8d0 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:46.074960 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-05e43add-152f-422f-ad28-3fba0ae8ae76 req-098dd8d5-e97b-46ac-bb9a-4f6138c8b8d0 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:46.087647 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-05e43add-152f-422f-ad28-3fba0ae8ae76 req-098dd8d5-e97b-46ac-bb9a-4f6138c8b8d0 service nova] Creating event network-changed:5cd649b3-0c07-4f95-a3b4-8e7e677cd269 for instance 982c0e01-d662-4756-b9c4-4f660054ed71 on hv-cinder-83124 Sep 09 13:24:46.093215 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-05e43add-152f-422f-ad28-3fba0ae8ae76 req-098dd8d5-e97b-46ac-bb9a-4f6138c8b8d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035044 Sep 09 13:24:46.094850 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 581/1154] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:24:46.178288 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-2a9679da-0a05-4c22-8bc4-a6ca3e125d6c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:46.185948 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-2a9679da-0a05-4c22-8bc4-a6ca3e125d6c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1265 microversion: 2.1 time: 0.163996 Sep 09 13:24:46.186519 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 574/1155] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:46 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:47.210384 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-0b50e0c6-af90-4afe-9837-66cb88927aa3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:47.211208 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-0b50e0c6-af90-4afe-9837-66cb88927aa3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:47.217381 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b50e0c6-af90-4afe-9837-66cb88927aa3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:47.217943 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b50e0c6-af90-4afe-9837-66cb88927aa3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:47.218355 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b50e0c6-af90-4afe-9837-66cb88927aa3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:47.219672 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b50e0c6-af90-4afe-9837-66cb88927aa3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:47.220122 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b50e0c6-af90-4afe-9837-66cb88927aa3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:47.220540 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-0b50e0c6-af90-4afe-9837-66cb88927aa3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:47.442074 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-0b50e0c6-af90-4afe-9837-66cb88927aa3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:47.449673 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-0b50e0c6-af90-4afe-9837-66cb88927aa3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1265 microversion: 2.1 time: 0.243961 Sep 09 13:24:47.450244 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 582/1156] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:47 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:48.472934 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-404de0b0-7c19-4c90-afa3-62207ee55d79 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:48.473537 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-404de0b0-7c19-4c90-afa3-62207ee55d79 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:48.479975 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-404de0b0-7c19-4c90-afa3-62207ee55d79 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:48.480457 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-404de0b0-7c19-4c90-afa3-62207ee55d79 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:48.480885 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-404de0b0-7c19-4c90-afa3-62207ee55d79 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:48.481572 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-404de0b0-7c19-4c90-afa3-62207ee55d79 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:48.482021 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-404de0b0-7c19-4c90-afa3-62207ee55d79 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:48.482441 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-404de0b0-7c19-4c90-afa3-62207ee55d79 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:48.618112 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-404de0b0-7c19-4c90-afa3-62207ee55d79 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:48.627952 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-404de0b0-7c19-4c90-afa3-62207ee55d79 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1265 microversion: 2.1 time: 0.159115 Sep 09 13:24:48.628536 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 575/1157] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:48 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:49.652077 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c0c8a7eb-1844-41d5-b58b-b0470e10027c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:49.652686 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c0c8a7eb-1844-41d5-b58b-b0470e10027c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:49.659809 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0c8a7eb-1844-41d5-b58b-b0470e10027c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:49.660295 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0c8a7eb-1844-41d5-b58b-b0470e10027c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:49.660734 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0c8a7eb-1844-41d5-b58b-b0470e10027c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:49.661426 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0c8a7eb-1844-41d5-b58b-b0470e10027c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:49.661878 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0c8a7eb-1844-41d5-b58b-b0470e10027c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:49.662298 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c0c8a7eb-1844-41d5-b58b-b0470e10027c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:49.798645 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c0c8a7eb-1844-41d5-b58b-b0470e10027c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:49.806284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c0c8a7eb-1844-41d5-b58b-b0470e10027c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1265 microversion: 2.1 time: 0.158065 Sep 09 13:24:49.806850 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 583/1158] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:49 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:50.829593 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-fb974bf8-d1d2-45fd-a481-b3ff0338e951 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:50.830235 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-fb974bf8-d1d2-45fd-a481-b3ff0338e951 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:50.836849 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb974bf8-d1d2-45fd-a481-b3ff0338e951 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:50.837332 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb974bf8-d1d2-45fd-a481-b3ff0338e951 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:50.837766 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb974bf8-d1d2-45fd-a481-b3ff0338e951 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:50.838455 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb974bf8-d1d2-45fd-a481-b3ff0338e951 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:50.838911 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb974bf8-d1d2-45fd-a481-b3ff0338e951 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:50.839363 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-fb974bf8-d1d2-45fd-a481-b3ff0338e951 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:50.973076 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-fb974bf8-d1d2-45fd-a481-b3ff0338e951 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:50.980699 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-fb974bf8-d1d2-45fd-a481-b3ff0338e951 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1265 microversion: 2.1 time: 0.155588 Sep 09 13:24:50.981264 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 576/1159] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:50 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:52.003854 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9429c4cc-1d43-4f10-8a8f-c6fba402177d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:52.004483 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9429c4cc-1d43-4f10-8a8f-c6fba402177d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:52.010332 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9429c4cc-1d43-4f10-8a8f-c6fba402177d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:52.010815 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9429c4cc-1d43-4f10-8a8f-c6fba402177d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:52.011294 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9429c4cc-1d43-4f10-8a8f-c6fba402177d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:52.011984 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9429c4cc-1d43-4f10-8a8f-c6fba402177d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:52.012439 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9429c4cc-1d43-4f10-8a8f-c6fba402177d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:52.012863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9429c4cc-1d43-4f10-8a8f-c6fba402177d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:52.148380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-9429c4cc-1d43-4f10-8a8f-c6fba402177d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:52.155959 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9429c4cc-1d43-4f10-8a8f-c6fba402177d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1265 microversion: 2.1 time: 0.156803 Sep 09 13:24:52.157165 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 584/1160] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:51 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:53.178174 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-393af7ca-d0ac-4575-a232-dce23896a70a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:53.178837 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-393af7ca-d0ac-4575-a232-dce23896a70a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:53.185246 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-393af7ca-d0ac-4575-a232-dce23896a70a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:53.185726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-393af7ca-d0ac-4575-a232-dce23896a70a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:53.186161 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-393af7ca-d0ac-4575-a232-dce23896a70a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:53.186849 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-393af7ca-d0ac-4575-a232-dce23896a70a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:53.187331 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-393af7ca-d0ac-4575-a232-dce23896a70a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:53.187757 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-393af7ca-d0ac-4575-a232-dce23896a70a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:53.320849 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-393af7ca-d0ac-4575-a232-dce23896a70a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:53.329160 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-393af7ca-d0ac-4575-a232-dce23896a70a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1265 microversion: 2.1 time: 0.154666 Sep 09 13:24:53.329755 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 577/1161] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:53 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:54.352895 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3c1e68bb-f78a-47d3-bd99-4ab2165d12ba tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:54.353509 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3c1e68bb-f78a-47d3-bd99-4ab2165d12ba tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:54.355902 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:54.356686 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=6 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:54.362487 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c1e68bb-f78a-47d3-bd99-4ab2165d12ba tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:54.362995 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c1e68bb-f78a-47d3-bd99-4ab2165d12ba tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:54.363453 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c1e68bb-f78a-47d3-bd99-4ab2165d12ba tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:54.364142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c1e68bb-f78a-47d3-bd99-4ab2165d12ba tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:54.364596 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c1e68bb-f78a-47d3-bd99-4ab2165d12ba tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:54.365018 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3c1e68bb-f78a-47d3-bd99-4ab2165d12ba tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:54.497477 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3c1e68bb-f78a-47d3-bd99-4ab2165d12ba tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:54.506078 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3c1e68bb-f78a-47d3-bd99-4ab2165d12ba tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1265 microversion: 2.1 time: 0.157125 Sep 09 13:24:54.506637 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 585/1162] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:54 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:55.528987 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d1b183a7-0e75-435c-b1c4-a2eaaaa2f5e3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:55.529602 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d1b183a7-0e75-435c-b1c4-a2eaaaa2f5e3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:55.532147 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:24:55.538286 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1b183a7-0e75-435c-b1c4-a2eaaaa2f5e3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:55.538767 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1b183a7-0e75-435c-b1c4-a2eaaaa2f5e3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:55.539236 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1b183a7-0e75-435c-b1c4-a2eaaaa2f5e3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:55.539919 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1b183a7-0e75-435c-b1c4-a2eaaaa2f5e3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:55.540365 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1b183a7-0e75-435c-b1c4-a2eaaaa2f5e3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:55.540781 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d1b183a7-0e75-435c-b1c4-a2eaaaa2f5e3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:55.674178 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d1b183a7-0e75-435c-b1c4-a2eaaaa2f5e3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:55.681814 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d1b183a7-0e75-435c-b1c4-a2eaaaa2f5e3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1265 microversion: 2.1 time: 0.156959 Sep 09 13:24:55.682374 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 578/1163] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:55 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:56.704497 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c3a7f8e0-e492-4090-9f10-6d15654a293f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:56.705178 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c3a7f8e0-e492-4090-9f10-6d15654a293f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:56.711538 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3a7f8e0-e492-4090-9f10-6d15654a293f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:56.712015 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3a7f8e0-e492-4090-9f10-6d15654a293f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:56.712445 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3a7f8e0-e492-4090-9f10-6d15654a293f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:56.713130 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3a7f8e0-e492-4090-9f10-6d15654a293f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:56.713572 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3a7f8e0-e492-4090-9f10-6d15654a293f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:56.713987 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c3a7f8e0-e492-4090-9f10-6d15654a293f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:56.770281 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-56b777ae-500a-4096-b069-2d633a4e534e req-6a916669-cd70-412a-8355-65df9256ac26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982c0e01-d662-4756-b9c4-4f660054ed71", "name": "network-vif-plugged", "status": "completed", "tag": "5cd649b3-0c07-4f95-a3b4-8e7e677cd269"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:24:56.783471 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-56b777ae-500a-4096-b069-2d633a4e534e req-6a916669-cd70-412a-8355-65df9256ac26 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:56.784245 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-56b777ae-500a-4096-b069-2d633a4e534e req-6a916669-cd70-412a-8355-65df9256ac26 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:56.784688 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-56b777ae-500a-4096-b069-2d633a4e534e req-6a916669-cd70-412a-8355-65df9256ac26 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:56.796464 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-56b777ae-500a-4096-b069-2d633a4e534e req-6a916669-cd70-412a-8355-65df9256ac26 service nova] Creating event network-vif-plugged:5cd649b3-0c07-4f95-a3b4-8e7e677cd269 for instance 982c0e01-d662-4756-b9c4-4f660054ed71 on hv-cinder-83124 Sep 09 13:24:56.801741 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-56b777ae-500a-4096-b069-2d633a4e534e req-6a916669-cd70-412a-8355-65df9256ac26 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037390 Sep 09 13:24:56.802761 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 579/1164] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:24:56.856747 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c3a7f8e0-e492-4090-9f10-6d15654a293f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:56.864988 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c3a7f8e0-e492-4090-9f10-6d15654a293f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1265 microversion: 2.1 time: 0.164572 Sep 09 13:24:56.865493 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 586/1165] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:56 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:57.888580 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f6ad18af-80c3-43c2-927b-f57e15b2dcf4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:57.889204 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f6ad18af-80c3-43c2-927b-f57e15b2dcf4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:57.896804 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6ad18af-80c3-43c2-927b-f57e15b2dcf4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:57.897293 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6ad18af-80c3-43c2-927b-f57e15b2dcf4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:57.897730 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6ad18af-80c3-43c2-927b-f57e15b2dcf4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:57.898454 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6ad18af-80c3-43c2-927b-f57e15b2dcf4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:57.898913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6ad18af-80c3-43c2-927b-f57e15b2dcf4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:57.899382 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f6ad18af-80c3-43c2-927b-f57e15b2dcf4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:58.028683 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f6ad18af-80c3-43c2-927b-f57e15b2dcf4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:58.037009 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f6ad18af-80c3-43c2-927b-f57e15b2dcf4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1265 microversion: 2.1 time: 0.152714 Sep 09 13:24:58.037714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 580/1166] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:57 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:59.060082 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-36365566-1da4-4d8a-a2b6-5c77778a9a84 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:59.060693 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-36365566-1da4-4d8a-a2b6-5c77778a9a84 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:59.068052 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36365566-1da4-4d8a-a2b6-5c77778a9a84 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:59.068534 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36365566-1da4-4d8a-a2b6-5c77778a9a84 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:59.068967 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36365566-1da4-4d8a-a2b6-5c77778a9a84 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:59.069656 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36365566-1da4-4d8a-a2b6-5c77778a9a84 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:59.070105 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36365566-1da4-4d8a-a2b6-5c77778a9a84 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:59.070524 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-36365566-1da4-4d8a-a2b6-5c77778a9a84 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:59.207143 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-36365566-1da4-4d8a-a2b6-5c77778a9a84 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:59.214803 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-36365566-1da4-4d8a-a2b6-5c77778a9a84 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1451 microversion: 2.1 time: 0.158597 Sep 09 13:24:59.215400 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 587/1167] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:59 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:24:59.237806 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d4292bfc-52a5-4cf3-acec-5df5e1b89de7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:24:59.238416 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d4292bfc-52a5-4cf3-acec-5df5e1b89de7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:24:59.244776 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4292bfc-52a5-4cf3-acec-5df5e1b89de7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:59.245251 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4292bfc-52a5-4cf3-acec-5df5e1b89de7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:59.245678 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4292bfc-52a5-4cf3-acec-5df5e1b89de7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:59.246358 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4292bfc-52a5-4cf3-acec-5df5e1b89de7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:24:59.246809 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4292bfc-52a5-4cf3-acec-5df5e1b89de7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:24:59.247258 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d4292bfc-52a5-4cf3-acec-5df5e1b89de7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:24:59.382787 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d4292bfc-52a5-4cf3-acec-5df5e1b89de7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:24:59.390645 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d4292bfc-52a5-4cf3-acec-5df5e1b89de7 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1451 microversion: 2.1 time: 0.157241 Sep 09 13:24:59.391233 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 581/1168] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:24:59 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:25:01.237678 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [req-4b60263f-f416-4686-bc3d-aca92729522d req-2d41b453-9906-4847-af55-a0c692006f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982c0e01-d662-4756-b9c4-4f660054ed71", "tag": "5cd649b3-0c07-4f95-a3b4-8e7e677cd269"}]} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:25:01.247847 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4b60263f-f416-4686-bc3d-aca92729522d req-2d41b453-9906-4847-af55-a0c692006f3b service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:25:01.248349 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4b60263f-f416-4686-bc3d-aca92729522d req-2d41b453-9906-4847-af55-a0c692006f3b service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:25:01.248781 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [req-4b60263f-f416-4686-bc3d-aca92729522d req-2d41b453-9906-4847-af55-a0c692006f3b service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:25:01.260528 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.compute.server_external_events [req-4b60263f-f416-4686-bc3d-aca92729522d req-2d41b453-9906-4847-af55-a0c692006f3b service nova] Creating event network-changed:5cd649b3-0c07-4f95-a3b4-8e7e677cd269 for instance 982c0e01-d662-4756-b9c4-4f660054ed71 on hv-cinder-83124 Sep 09 13:25:01.266426 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [req-4b60263f-f416-4686-bc3d-aca92729522d req-2d41b453-9906-4847-af55-a0c692006f3b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032281 Sep 09 13:25:01.267022 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 588/1169] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:26:55.508435 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR oslo.messaging._drivers.impl_rabbit [-] [70d3eb04-e5be-4645-9d88-ed20bd00aa6e] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 09 13:26:55.509437 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 09 13:26:55.509572 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Fri Sep 9 13:26:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 (ip 10.222.0.17) !!! Sep 09 13:26:55.510851 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 13:26:55.511011 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Fri Sep 9 13:26:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 (ip 10.222.0.17) !!! Sep 09 13:26:55.511989 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=20 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:55.513003 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=44 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:55.517634 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-44a24836-649d-4ea7-9aa4-ebf5cd9a2180 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:26:55.518135 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-44a24836-649d-4ea7-9aa4-ebf5cd9a2180 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:26:55.528575 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-44a24836-649d-4ea7-9aa4-ebf5cd9a2180 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:26:55.529100 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-44a24836-649d-4ea7-9aa4-ebf5cd9a2180 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:26:55.529548 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-44a24836-649d-4ea7-9aa4-ebf5cd9a2180 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:26:55.530250 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-44a24836-649d-4ea7-9aa4-ebf5cd9a2180 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:26:55.530708 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-44a24836-649d-4ea7-9aa4-ebf5cd9a2180 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:26:55.531163 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-44a24836-649d-4ea7-9aa4-ebf5cd9a2180 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:26:55.557530 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-44a24836-649d-4ea7-9aa4-ebf5cd9a2180 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Going to try to terminate instance {{(pid=120623) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:26:55.639278 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-44a24836-649d-4ea7-9aa4-ebf5cd9a2180 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "DELETE /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 204 len: 0 microversion: 2.1 time: 0.132735 Sep 09 13:26:55.640082 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 582/1170] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:26:55 2022] DELETE /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:26:55.646244 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR oslo.messaging._drivers.impl_rabbit [-] [831e2319-63e4-4fc2-8641-f13a9e9a5a81] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 13:26:55.647307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 09 13:26:55.647434 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Fri Sep 9 13:26:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 (ip 10.222.0.17) !!! Sep 09 13:26:55.648725 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:55.649462 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=48 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:26:55.650429 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 09 13:26:55.650606 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Fri Sep 9 13:26:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 (ip 10.222.0.17) !!! Sep 09 13:26:55.657253 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-cd60bde1-410c-4674-9386-d54a55f57d0c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:26:55.657953 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-cd60bde1-410c-4674-9386-d54a55f57d0c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:26:55.667906 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd60bde1-410c-4674-9386-d54a55f57d0c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:26:55.668392 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd60bde1-410c-4674-9386-d54a55f57d0c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:26:55.668880 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd60bde1-410c-4674-9386-d54a55f57d0c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:26:55.669573 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd60bde1-410c-4674-9386-d54a55f57d0c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:26:55.670020 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd60bde1-410c-4674-9386-d54a55f57d0c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:26:55.670444 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-cd60bde1-410c-4674-9386-d54a55f57d0c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:26:55.803246 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-cd60bde1-410c-4674-9386-d54a55f57d0c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:26:55.811789 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-cd60bde1-410c-4674-9386-d54a55f57d0c tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1576 microversion: 2.1 time: 0.167385 Sep 09 13:26:55.812352 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 589/1171] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:26:55 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:26:56.836140 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-413f3ee2-57fa-4bf2-9b18-6b9d4a8098d3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:26:56.836832 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-413f3ee2-57fa-4bf2-9b18-6b9d4a8098d3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:26:56.846128 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] [70d3eb04-e5be-4645-9d88-ed20bd00aa6e] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 44262. Sep 09 13:26:56.851262 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-413f3ee2-57fa-4bf2-9b18-6b9d4a8098d3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:26:56.851743 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-413f3ee2-57fa-4bf2-9b18-6b9d4a8098d3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:26:56.852176 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-413f3ee2-57fa-4bf2-9b18-6b9d4a8098d3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:26:56.852859 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-413f3ee2-57fa-4bf2-9b18-6b9d4a8098d3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:26:56.853308 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-413f3ee2-57fa-4bf2-9b18-6b9d4a8098d3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:26:56.853726 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-413f3ee2-57fa-4bf2-9b18-6b9d4a8098d3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:26:56.988164 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-413f3ee2-57fa-4bf2-9b18-6b9d4a8098d3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:26:56.995794 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-413f3ee2-57fa-4bf2-9b18-6b9d4a8098d3 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1576 microversion: 2.1 time: 0.163866 Sep 09 13:26:56.996361 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 583/1172] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:26:56 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:26:58.019830 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-98c67c3d-2dc2-4dbc-83a5-f1d5a7df496b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:26:58.020449 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-98c67c3d-2dc2-4dbc-83a5-f1d5a7df496b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:26:58.028209 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98c67c3d-2dc2-4dbc-83a5-f1d5a7df496b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:26:58.028697 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98c67c3d-2dc2-4dbc-83a5-f1d5a7df496b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:26:58.029338 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98c67c3d-2dc2-4dbc-83a5-f1d5a7df496b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:26:58.030054 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98c67c3d-2dc2-4dbc-83a5-f1d5a7df496b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:26:58.030512 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98c67c3d-2dc2-4dbc-83a5-f1d5a7df496b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:26:58.030937 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98c67c3d-2dc2-4dbc-83a5-f1d5a7df496b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:26:58.052702 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] [831e2319-63e4-4fc2-8641-f13a9e9a5a81] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 44268. Sep 09 13:26:58.104881 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-98c67c3d-2dc2-4dbc-83a5-f1d5a7df496b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:26:58.113144 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-98c67c3d-2dc2-4dbc-83a5-f1d5a7df496b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 200 len: 1509 microversion: 2.1 time: 0.097034 Sep 09 13:26:58.119172 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 590/1173] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:26:58 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 1509 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:26:58.250897 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-6c487cbd-d0c2-4e84-8557-ba9da08fb9b4 req-20d062a3-1122-42ad-8a7a-65c7b646fcdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982c0e01-d662-4756-b9c4-4f660054ed71", "name": "network-vif-deleted", "tag": "5cd649b3-0c07-4f95-a3b4-8e7e677cd269"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:26:58.261929 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6c487cbd-d0c2-4e84-8557-ba9da08fb9b4 req-20d062a3-1122-42ad-8a7a-65c7b646fcdf service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:26:58.262971 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6c487cbd-d0c2-4e84-8557-ba9da08fb9b4 req-20d062a3-1122-42ad-8a7a-65c7b646fcdf service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:26:58.263808 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6c487cbd-d0c2-4e84-8557-ba9da08fb9b4 req-20d062a3-1122-42ad-8a7a-65c7b646fcdf service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:26:58.276285 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-6c487cbd-d0c2-4e84-8557-ba9da08fb9b4 req-20d062a3-1122-42ad-8a7a-65c7b646fcdf service nova] Creating event network-vif-deleted:5cd649b3-0c07-4f95-a3b4-8e7e677cd269 for instance 982c0e01-d662-4756-b9c4-4f660054ed71 on hv-cinder-83124 Sep 09 13:26:58.284229 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-6c487cbd-d0c2-4e84-8557-ba9da08fb9b4 req-20d062a3-1122-42ad-8a7a-65c7b646fcdf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115348 Sep 09 13:26:58.284951 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 584/1174] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:26:59.137247 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bc9450ad-8ee9-4c5a-b12f-5f54450bb481 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:26:59.137938 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bc9450ad-8ee9-4c5a-b12f-5f54450bb481 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:26:59.144863 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc9450ad-8ee9-4c5a-b12f-5f54450bb481 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:26:59.145343 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc9450ad-8ee9-4c5a-b12f-5f54450bb481 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:26:59.145779 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc9450ad-8ee9-4c5a-b12f-5f54450bb481 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:26:59.146476 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc9450ad-8ee9-4c5a-b12f-5f54450bb481 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:26:59.146892 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc9450ad-8ee9-4c5a-b12f-5f54450bb481 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:26:59.147466 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bc9450ad-8ee9-4c5a-b12f-5f54450bb481 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:26:59.161505 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-bc9450ad-8ee9-4c5a-b12f-5f54450bb481 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] HTTP exception thrown: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bc9450ad-8ee9-4c5a-b12f-5f54450bb481 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Request method failure captured: Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 HTTP/1.1 Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGz6GzI1Uyle-Gz1YxLC3KiPbSFzGZT8Pt_cIenmZMxXss7FIYyZSjlzf-_-TZq9MXG9BXzKs_KrNi1gPlRyhFxgiYQYboRwAE8YxPv2weht3x7Fpin-PDE3kFrsquP-RJdHRrkIUxALFzBplnX5YJrY0Tt3Lynz8lkMHAR-3VcrGZKE Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: b7dd3b78c2a74ac4baa2f0bb21482ed9 Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-TestVolumeBootPattern-782269405 Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:26:59.163286 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:26:59.165142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b7dd3b78c2a74ac4baa2f0bb21482ed9", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:26:59.165142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-TestVolumeBootPattern-782269405 Sep 09 13:26:59.165142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: b7dd3b78c2a74ac4baa2f0bb21482ed9 Sep 09 13:26:59.165142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestVolumeBootPattern-782269405 Sep 09 13:26:59.165142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-TestVolumeBootPattern-782269405-project Sep 09 13:26:59.165142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:26:59.165142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:26:59.165142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: 5ab98652cbab470b8a385fe6381dd80b Sep 09 13:26:59.165142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-TestVolumeBootPattern-782269405-project Sep 09 13:26:59.165142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:26:59.165142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:26:59.165142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '982c0e01-d662-4756-b9c4-4f660054ed71'} Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:26:59.166380 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:26:59.168155 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:26:59.170261 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bc9450ad-8ee9-4c5a-b12f-5f54450bb481 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Returning 404 to user: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:26:59.170261 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bc9450ad-8ee9-4c5a-b12f-5f54450bb481 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 404 len: 111 microversion: 2.1 time: 0.031584 Sep 09 13:26:59.170261 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 591/1175] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:26:59 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:26:59.213961 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1831275279", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-826659176", "security_groups": [{"name": "tempest-secgroup-smoke-216769747"}], "block_device_mapping_v2": [{"uuid": "14b4dbd1-f4d5-4a7d-a972-6b50413acd84", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ec5175a-de79-45cd-b4bc-8c6a9172e979"}]}} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:26:59.327839 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.network.neutron [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] validate_networks() for [('5ec5175a-de79-45cd-b4bc-8c6a9172e979', None, None, None, None, None)] {{(pid=120623) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:26:59.692686 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Flavor limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:26:59.693143 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Image limits 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:26:59.693618 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Flavor pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:26:59.694052 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Image pref 0:0:0 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:26:59.694460 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.virt.hardware [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120623) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:26:59.703268 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:26:59.703749 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:26:59.704184 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:26:59.704903 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:26:59.705354 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:26:59.705775 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:26:59.722631 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Getting quotas for project b7dd3b78c2a74ac4baa2f0bb21482ed9. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:26:59.726528 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.quota [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Getting quotas for user 5ab98652cbab470b8a385fe6381dd80b and project b7dd3b78c2a74ac4baa2f0bb21482ed9. Resources: {'ram', 'instances', 'cores'} {{(pid=120623) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:26:59.786345 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Going to run 1 instances... {{(pid=120623) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:26:59.788605 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14b4dbd1-f4d5-4a7d-a972-6b50413acd84',volume_size=None,volume_type=None)] {{(pid=120623) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:26:59.917927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d20c21f1-564e-4b34-ba0b-070f6e7cd285 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.708007 Sep 09 13:26:59.918984 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 585/1176] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:26:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:26:59.930129 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-653cab0a-78da-465e-8525-16c655c448c2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:26:59.931014 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-653cab0a-78da-465e-8525-16c655c448c2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:26:59.985649 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-653cab0a-78da-465e-8525-16c655c448c2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:26:59.992526 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-653cab0a-78da-465e-8525-16c655c448c2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1094 microversion: 2.1 time: 0.066284 Sep 09 13:26:59.993079 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 592/1177] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:26:59 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:01.017908 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8acc9610-b3b9-4114-9d5e-c922d292d1f2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:27:01.019289 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8acc9610-b3b9-4114-9d5e-c922d292d1f2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:27:01.025852 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8acc9610-b3b9-4114-9d5e-c922d292d1f2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:01.026462 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8acc9610-b3b9-4114-9d5e-c922d292d1f2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:01.026902 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8acc9610-b3b9-4114-9d5e-c922d292d1f2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:01.027619 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8acc9610-b3b9-4114-9d5e-c922d292d1f2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:01.028092 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8acc9610-b3b9-4114-9d5e-c922d292d1f2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:01.028839 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8acc9610-b3b9-4114-9d5e-c922d292d1f2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:01.093743 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8acc9610-b3b9-4114-9d5e-c922d292d1f2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:27:01.101905 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8acc9610-b3b9-4114-9d5e-c922d292d1f2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1210 microversion: 2.1 time: 0.090343 Sep 09 13:27:01.102741 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 586/1178] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:27:01 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:02.125856 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-98ef25c8-7a26-41a4-be7c-fdda41f4e7e9 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:27:02.126473 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-98ef25c8-7a26-41a4-be7c-fdda41f4e7e9 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:27:02.134485 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98ef25c8-7a26-41a4-be7c-fdda41f4e7e9 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:02.134977 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98ef25c8-7a26-41a4-be7c-fdda41f4e7e9 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:02.135474 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98ef25c8-7a26-41a4-be7c-fdda41f4e7e9 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:02.136188 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98ef25c8-7a26-41a4-be7c-fdda41f4e7e9 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:02.136648 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98ef25c8-7a26-41a4-be7c-fdda41f4e7e9 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:02.137073 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-98ef25c8-7a26-41a4-be7c-fdda41f4e7e9 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:02.469922 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-98ef25c8-7a26-41a4-be7c-fdda41f4e7e9 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:27:02.478562 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-98ef25c8-7a26-41a4-be7c-fdda41f4e7e9 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1265 microversion: 2.1 time: 0.356892 Sep 09 13:27:02.479145 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 593/1179] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:27:02 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1265 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:02.675546 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-95bfdebd-f89e-4221-8ac7-d5c3098d367d req-e70af6dd-f968-4119-a5a0-85df64a09f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81fd4b5-5e20-4394-989e-72ae8e685dec", "tag": "1cde3fbe-c7f7-485a-ae94-ea8608a52b62"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:27:02.687264 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-95bfdebd-f89e-4221-8ac7-d5c3098d367d req-e70af6dd-f968-4119-a5a0-85df64a09f37 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:02.688001 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-95bfdebd-f89e-4221-8ac7-d5c3098d367d req-e70af6dd-f968-4119-a5a0-85df64a09f37 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:02.688433 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-95bfdebd-f89e-4221-8ac7-d5c3098d367d req-e70af6dd-f968-4119-a5a0-85df64a09f37 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:02.699850 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-95bfdebd-f89e-4221-8ac7-d5c3098d367d req-e70af6dd-f968-4119-a5a0-85df64a09f37 service nova] Creating event network-changed:1cde3fbe-c7f7-485a-ae94-ea8608a52b62 for instance a81fd4b5-5e20-4394-989e-72ae8e685dec on hv-cinder-83124 Sep 09 13:27:02.704763 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-95bfdebd-f89e-4221-8ac7-d5c3098d367d req-e70af6dd-f968-4119-a5a0-85df64a09f37 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033119 Sep 09 13:27:02.705723 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 587/1180] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:27:03.503526 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a86c14cf-2e52-4591-bbda-b7cfd9a2ed20 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:27:03.504167 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a86c14cf-2e52-4591-bbda-b7cfd9a2ed20 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:27:03.510912 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a86c14cf-2e52-4591-bbda-b7cfd9a2ed20 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:03.511453 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a86c14cf-2e52-4591-bbda-b7cfd9a2ed20 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:03.511890 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a86c14cf-2e52-4591-bbda-b7cfd9a2ed20 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:03.513240 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a86c14cf-2e52-4591-bbda-b7cfd9a2ed20 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:03.513697 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a86c14cf-2e52-4591-bbda-b7cfd9a2ed20 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:03.514123 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a86c14cf-2e52-4591-bbda-b7cfd9a2ed20 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:03.734949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a86c14cf-2e52-4591-bbda-b7cfd9a2ed20 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:27:03.742749 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a86c14cf-2e52-4591-bbda-b7cfd9a2ed20 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1265 microversion: 2.1 time: 0.243094 Sep 09 13:27:03.743362 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 594/1181] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:27:03 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:04.767886 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-ceb6212d-70d6-4c0e-a977-d54191eeb1ae tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:27:04.768614 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-ceb6212d-70d6-4c0e-a977-d54191eeb1ae tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:27:04.774772 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ceb6212d-70d6-4c0e-a977-d54191eeb1ae tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:04.775281 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ceb6212d-70d6-4c0e-a977-d54191eeb1ae tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:04.775719 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ceb6212d-70d6-4c0e-a977-d54191eeb1ae tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:04.776402 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ceb6212d-70d6-4c0e-a977-d54191eeb1ae tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:04.776856 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ceb6212d-70d6-4c0e-a977-d54191eeb1ae tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:04.777278 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-ceb6212d-70d6-4c0e-a977-d54191eeb1ae tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:04.913659 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-ceb6212d-70d6-4c0e-a977-d54191eeb1ae tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:27:04.921941 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-ceb6212d-70d6-4c0e-a977-d54191eeb1ae tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1265 microversion: 2.1 time: 0.159576 Sep 09 13:27:04.922513 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 588/1182] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:27:04 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:05.945373 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b68007e0-23c4-438f-a361-e75ff0e0a345 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:27:05.946007 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b68007e0-23c4-438f-a361-e75ff0e0a345 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:27:05.953429 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b68007e0-23c4-438f-a361-e75ff0e0a345 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:05.953905 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b68007e0-23c4-438f-a361-e75ff0e0a345 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:05.954334 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b68007e0-23c4-438f-a361-e75ff0e0a345 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:05.955015 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b68007e0-23c4-438f-a361-e75ff0e0a345 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:05.955489 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b68007e0-23c4-438f-a361-e75ff0e0a345 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:05.955904 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b68007e0-23c4-438f-a361-e75ff0e0a345 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:06.086171 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b68007e0-23c4-438f-a361-e75ff0e0a345 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:27:06.094585 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b68007e0-23c4-438f-a361-e75ff0e0a345 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1265 microversion: 2.1 time: 0.153118 Sep 09 13:27:06.095173 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 595/1183] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:27:05 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:07.118226 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9f5da07b-ba56-4a14-8171-f61382c5abeb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:27:07.118895 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9f5da07b-ba56-4a14-8171-f61382c5abeb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:27:07.125466 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f5da07b-ba56-4a14-8171-f61382c5abeb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:07.125948 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f5da07b-ba56-4a14-8171-f61382c5abeb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:07.126387 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f5da07b-ba56-4a14-8171-f61382c5abeb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:07.127099 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f5da07b-ba56-4a14-8171-f61382c5abeb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:07.127559 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f5da07b-ba56-4a14-8171-f61382c5abeb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:07.127986 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9f5da07b-ba56-4a14-8171-f61382c5abeb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:07.257150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9f5da07b-ba56-4a14-8171-f61382c5abeb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:27:07.265396 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9f5da07b-ba56-4a14-8171-f61382c5abeb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1265 microversion: 2.1 time: 0.151818 Sep 09 13:27:07.265963 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 589/1184] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:27:07 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:08.288285 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8af92ead-4616-4113-b287-0ff0f4249521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:27:08.288818 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8af92ead-4616-4113-b287-0ff0f4249521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:27:08.295784 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8af92ead-4616-4113-b287-0ff0f4249521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:08.296263 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8af92ead-4616-4113-b287-0ff0f4249521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:08.296697 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8af92ead-4616-4113-b287-0ff0f4249521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:08.297383 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8af92ead-4616-4113-b287-0ff0f4249521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:08.297860 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8af92ead-4616-4113-b287-0ff0f4249521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:08.298279 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8af92ead-4616-4113-b287-0ff0f4249521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:08.430095 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8af92ead-4616-4113-b287-0ff0f4249521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:27:08.438439 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8af92ead-4616-4113-b287-0ff0f4249521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1265 microversion: 2.1 time: 0.154222 Sep 09 13:27:08.438997 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 596/1185] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:27:08 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:09.461204 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-338ec2b1-c87c-4acb-a0e2-9169d64c3664 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:27:09.461821 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-338ec2b1-c87c-4acb-a0e2-9169d64c3664 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:27:09.468501 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-338ec2b1-c87c-4acb-a0e2-9169d64c3664 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:09.468980 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-338ec2b1-c87c-4acb-a0e2-9169d64c3664 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:09.469417 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-338ec2b1-c87c-4acb-a0e2-9169d64c3664 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:09.470103 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-338ec2b1-c87c-4acb-a0e2-9169d64c3664 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:09.470566 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-338ec2b1-c87c-4acb-a0e2-9169d64c3664 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:09.470993 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-338ec2b1-c87c-4acb-a0e2-9169d64c3664 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:09.603322 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-338ec2b1-c87c-4acb-a0e2-9169d64c3664 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:27:09.611856 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-338ec2b1-c87c-4acb-a0e2-9169d64c3664 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1265 microversion: 2.1 time: 0.154479 Sep 09 13:27:09.612749 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 590/1186] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:27:09 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:10.635783 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-07b2bf8d-1a83-4e93-886f-0dc2b9f3ace2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:27:10.636389 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-07b2bf8d-1a83-4e93-886f-0dc2b9f3ace2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:27:10.639481 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:10.644736 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07b2bf8d-1a83-4e93-886f-0dc2b9f3ace2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:10.645213 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07b2bf8d-1a83-4e93-886f-0dc2b9f3ace2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:10.645640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07b2bf8d-1a83-4e93-886f-0dc2b9f3ace2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:10.646320 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07b2bf8d-1a83-4e93-886f-0dc2b9f3ace2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:10.646766 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07b2bf8d-1a83-4e93-886f-0dc2b9f3ace2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:10.647210 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-07b2bf8d-1a83-4e93-886f-0dc2b9f3ace2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:10.780688 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-07b2bf8d-1a83-4e93-886f-0dc2b9f3ace2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:27:10.788379 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-07b2bf8d-1a83-4e93-886f-0dc2b9f3ace2 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1265 microversion: 2.1 time: 0.156493 Sep 09 13:27:10.788938 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 597/1187] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:27:10 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:11.812303 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-903b9a6f-68ea-4f6d-b05a-11e441ac818f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:27:11.812840 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-903b9a6f-68ea-4f6d-b05a-11e441ac818f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:27:11.814758 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=2 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:11.815439 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=6 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:27:11.821783 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-903b9a6f-68ea-4f6d-b05a-11e441ac818f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:11.822268 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-903b9a6f-68ea-4f6d-b05a-11e441ac818f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:11.822704 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-903b9a6f-68ea-4f6d-b05a-11e441ac818f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:11.823439 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-903b9a6f-68ea-4f6d-b05a-11e441ac818f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:11.823926 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-903b9a6f-68ea-4f6d-b05a-11e441ac818f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:11.824383 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-903b9a6f-68ea-4f6d-b05a-11e441ac818f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:11.959219 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-903b9a6f-68ea-4f6d-b05a-11e441ac818f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:27:11.967232 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-903b9a6f-68ea-4f6d-b05a-11e441ac818f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1265 microversion: 2.1 time: 0.159605 Sep 09 13:27:11.967798 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 591/1188] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:27:11 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:12.989721 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c668e5fa-5c44-4c21-b54f-5ae30cf557a6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:27:12.990363 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c668e5fa-5c44-4c21-b54f-5ae30cf557a6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:27:12.996840 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c668e5fa-5c44-4c21-b54f-5ae30cf557a6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:12.997320 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c668e5fa-5c44-4c21-b54f-5ae30cf557a6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:12.997755 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c668e5fa-5c44-4c21-b54f-5ae30cf557a6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:12.998443 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c668e5fa-5c44-4c21-b54f-5ae30cf557a6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:12.998896 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c668e5fa-5c44-4c21-b54f-5ae30cf557a6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:12.999355 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c668e5fa-5c44-4c21-b54f-5ae30cf557a6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:13.132929 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c668e5fa-5c44-4c21-b54f-5ae30cf557a6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:27:13.140775 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c668e5fa-5c44-4c21-b54f-5ae30cf557a6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1265 microversion: 2.1 time: 0.154953 Sep 09 13:27:13.141343 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 598/1189] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:27:12 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:13.419853 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-22c7b546-1790-4174-9ef4-b275f5586380 req-ada322c8-97f6-4f47-9620-cb9d706a7a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81fd4b5-5e20-4394-989e-72ae8e685dec", "name": "network-vif-plugged", "status": "completed", "tag": "1cde3fbe-c7f7-485a-ae94-ea8608a52b62"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:27:13.429286 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-22c7b546-1790-4174-9ef4-b275f5586380 req-ada322c8-97f6-4f47-9620-cb9d706a7a6c service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:13.429758 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-22c7b546-1790-4174-9ef4-b275f5586380 req-ada322c8-97f6-4f47-9620-cb9d706a7a6c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:13.430188 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-22c7b546-1790-4174-9ef4-b275f5586380 req-ada322c8-97f6-4f47-9620-cb9d706a7a6c service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:13.441256 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-22c7b546-1790-4174-9ef4-b275f5586380 req-ada322c8-97f6-4f47-9620-cb9d706a7a6c service nova] Creating event network-vif-plugged:1cde3fbe-c7f7-485a-ae94-ea8608a52b62 for instance a81fd4b5-5e20-4394-989e-72ae8e685dec on hv-cinder-83124 Sep 09 13:27:13.446256 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-22c7b546-1790-4174-9ef4-b275f5586380 req-ada322c8-97f6-4f47-9620-cb9d706a7a6c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089917 Sep 09 13:27:13.446936 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 592/1190] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:27:14.163966 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-1e5d08bc-43e7-45bd-846c-8cc278234fdb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:27:14.164577 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-1e5d08bc-43e7-45bd-846c-8cc278234fdb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:27:14.171181 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e5d08bc-43e7-45bd-846c-8cc278234fdb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:14.171662 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e5d08bc-43e7-45bd-846c-8cc278234fdb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:14.172096 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e5d08bc-43e7-45bd-846c-8cc278234fdb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:14.172781 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e5d08bc-43e7-45bd-846c-8cc278234fdb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:14.173229 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e5d08bc-43e7-45bd-846c-8cc278234fdb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:14.173650 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-1e5d08bc-43e7-45bd-846c-8cc278234fdb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:14.303491 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-1e5d08bc-43e7-45bd-846c-8cc278234fdb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:27:14.311782 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-1e5d08bc-43e7-45bd-846c-8cc278234fdb tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1265 microversion: 2.1 time: 0.151782 Sep 09 13:27:14.312357 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 599/1191] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:27:14 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:15.334992 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-f090cb07-f707-4cca-be70-c18b98612bc5 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:27:15.335714 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-f090cb07-f707-4cca-be70-c18b98612bc5 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:27:15.342348 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f090cb07-f707-4cca-be70-c18b98612bc5 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:15.342828 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f090cb07-f707-4cca-be70-c18b98612bc5 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:15.343294 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f090cb07-f707-4cca-be70-c18b98612bc5 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:15.343977 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f090cb07-f707-4cca-be70-c18b98612bc5 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:15.344425 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f090cb07-f707-4cca-be70-c18b98612bc5 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:15.344845 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-f090cb07-f707-4cca-be70-c18b98612bc5 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:15.474541 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-f090cb07-f707-4cca-be70-c18b98612bc5 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:27:15.482795 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-f090cb07-f707-4cca-be70-c18b98612bc5 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1451 microversion: 2.1 time: 0.151942 Sep 09 13:27:15.483399 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 593/1192] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:27:15 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:15.505504 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c510137d-daa9-4a29-9193-8fad45931779 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:27:15.506121 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c510137d-daa9-4a29-9193-8fad45931779 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:27:15.513037 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c510137d-daa9-4a29-9193-8fad45931779 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:15.513512 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c510137d-daa9-4a29-9193-8fad45931779 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:15.513939 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c510137d-daa9-4a29-9193-8fad45931779 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:15.514618 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c510137d-daa9-4a29-9193-8fad45931779 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:15.515081 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c510137d-daa9-4a29-9193-8fad45931779 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:15.515504 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c510137d-daa9-4a29-9193-8fad45931779 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:15.649217 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c510137d-daa9-4a29-9193-8fad45931779 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:27:15.657064 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c510137d-daa9-4a29-9193-8fad45931779 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1451 microversion: 2.1 time: 0.155542 Sep 09 13:27:15.657632 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 600/1193] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:27:15 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:27:17.216712 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-7354a13e-8ede-4e2c-83cd-5c54ce2dfd05 req-7b9c8770-d324-4d34-86ab-4bfa51d7e339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81fd4b5-5e20-4394-989e-72ae8e685dec", "tag": "1cde3fbe-c7f7-485a-ae94-ea8608a52b62"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:27:17.226991 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-7354a13e-8ede-4e2c-83cd-5c54ce2dfd05 req-7b9c8770-d324-4d34-86ab-4bfa51d7e339 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:27:17.227698 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-7354a13e-8ede-4e2c-83cd-5c54ce2dfd05 req-7b9c8770-d324-4d34-86ab-4bfa51d7e339 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:27:17.228128 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-7354a13e-8ede-4e2c-83cd-5c54ce2dfd05 req-7b9c8770-d324-4d34-86ab-4bfa51d7e339 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:27:17.239539 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-7354a13e-8ede-4e2c-83cd-5c54ce2dfd05 req-7b9c8770-d324-4d34-86ab-4bfa51d7e339 service nova] Creating event network-changed:1cde3fbe-c7f7-485a-ae94-ea8608a52b62 for instance a81fd4b5-5e20-4394-989e-72ae8e685dec on hv-cinder-83124 Sep 09 13:27:17.244286 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-7354a13e-8ede-4e2c-83cd-5c54ce2dfd05 req-7b9c8770-d324-4d34-86ab-4bfa51d7e339 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031857 Sep 09 13:27:17.244879 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 594/1194] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:29:02.985669 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=26 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:29:02.986410 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=62 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:29:02.987769 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 13:29:02.987926 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Fri Sep 9 13:29:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Sep 09 13:29:02.993567 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1672082970", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-826659176", "security_groups": [{"name": "tempest-secgroup-smoke-216769747"}], "block_device_mapping_v2": [{"uuid": "e7548fbe-eeda-4bba-9e4d-88419341246b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ec5175a-de79-45cd-b4bc-8c6a9172e979"}]}} {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:29:03.114229 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.network.neutron [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] validate_networks() for [('5ec5175a-de79-45cd-b4bc-8c6a9172e979', None, None, None, None, None)] {{(pid=120625) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 13:29:03.531769 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Flavor limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 13:29:03.532190 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Image limits 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 13:29:03.532661 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Flavor pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 13:29:03.533091 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Image pref 0:0:0 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 13:29:03.533498 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.virt.hardware [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120625) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 13:29:03.542125 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:03.542603 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:03.543036 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:03.543786 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:03.544244 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:03.544654 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:03.561244 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Getting quotas for project b7dd3b78c2a74ac4baa2f0bb21482ed9. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 13:29:03.565111 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.quota [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Getting quotas for user 5ab98652cbab470b8a385fe6381dd80b and project b7dd3b78c2a74ac4baa2f0bb21482ed9. Resources: {'ram', 'instances', 'cores'} {{(pid=120625) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 13:29:03.621733 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Going to run 1 instances... {{(pid=120625) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 13:29:03.623898 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e7548fbe-eeda-4bba-9e4d-88419341246b',volume_size=None,volume_type=None)] {{(pid=120625) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 13:29:03.754698 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bdaba278-f3e1-48aa-bca9-6c15723b60ca tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.770746 Sep 09 13:29:03.755360 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 601/1195] 10.222.0.17 () {60 vars in 1147 bytes} [Fri Sep 9 13:29:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 13:29:03.767695 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR oslo.messaging._drivers.impl_rabbit [-] [70d3eb04-e5be-4645-9d88-ed20bd00aa6e] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 09 13:29:03.768294 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:29:03.769048 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:29:03.775500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-6c3a241a-3408-4a58-8c01-42a7964275d0 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:03.776204 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-6c3a241a-3408-4a58-8c01-42a7964275d0 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:03.838498 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-6c3a241a-3408-4a58-8c01-42a7964275d0 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:03.845291 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-6c3a241a-3408-4a58-8c01-42a7964275d0 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1094 microversion: 2.1 time: 0.081167 Sep 09 13:29:03.845857 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 595/1196] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:03 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:04.869295 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-5f988339-0f2d-4112-ad1d-88b3821e1a74 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:04.869911 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-5f988339-0f2d-4112-ad1d-88b3821e1a74 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:04.922311 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-5f988339-0f2d-4112-ad1d-88b3821e1a74 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:04.929717 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-5f988339-0f2d-4112-ad1d-88b3821e1a74 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1094 microversion: 2.1 time: 0.064751 Sep 09 13:29:04.930487 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 602/1197] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:04 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:05.953130 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-0d0efece-500c-49ec-ac09-c87762632a8a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:05.953748 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-0d0efece-500c-49ec-ac09-c87762632a8a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:05.966375 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] [70d3eb04-e5be-4645-9d88-ed20bd00aa6e] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 44440. Sep 09 13:29:06.013458 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-0d0efece-500c-49ec-ac09-c87762632a8a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:06.020456 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-0d0efece-500c-49ec-ac09-c87762632a8a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1094 microversion: 2.1 time: 0.071215 Sep 09 13:29:06.021015 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 596/1198] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:05 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:07.043135 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-4934cac4-d0ba-472e-bd1d-2aa8b03524ed tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:07.043758 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-4934cac4-d0ba-472e-bd1d-2aa8b03524ed tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:07.098406 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-4934cac4-d0ba-472e-bd1d-2aa8b03524ed tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:07.105305 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-4934cac4-d0ba-472e-bd1d-2aa8b03524ed tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1094 microversion: 2.1 time: 0.066181 Sep 09 13:29:07.105865 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 603/1199] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:07 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:08.128269 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-d0debc7e-4594-47a0-9dc0-f4b24781c49b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:08.129006 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-d0debc7e-4594-47a0-9dc0-f4b24781c49b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:08.136757 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0debc7e-4594-47a0-9dc0-f4b24781c49b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:08.137317 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0debc7e-4594-47a0-9dc0-f4b24781c49b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:08.137824 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0debc7e-4594-47a0-9dc0-f4b24781c49b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:08.138618 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0debc7e-4594-47a0-9dc0-f4b24781c49b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:08.139170 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0debc7e-4594-47a0-9dc0-f4b24781c49b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:08.139663 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-d0debc7e-4594-47a0-9dc0-f4b24781c49b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:08.202980 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-d0debc7e-4594-47a0-9dc0-f4b24781c49b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:08.212059 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-d0debc7e-4594-47a0-9dc0-f4b24781c49b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1144 microversion: 2.1 time: 0.087446 Sep 09 13:29:08.212653 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 597/1200] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:08 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:09.237768 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-543bc6b9-9d60-4ca0-90cf-089df07ef892 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:09.238525 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-543bc6b9-9d60-4ca0-90cf-089df07ef892 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:09.247604 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543bc6b9-9d60-4ca0-90cf-089df07ef892 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:09.248327 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543bc6b9-9d60-4ca0-90cf-089df07ef892 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:09.248913 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543bc6b9-9d60-4ca0-90cf-089df07ef892 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:09.249636 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543bc6b9-9d60-4ca0-90cf-089df07ef892 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:09.250084 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543bc6b9-9d60-4ca0-90cf-089df07ef892 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:09.250708 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-543bc6b9-9d60-4ca0-90cf-089df07ef892 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:09.323465 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-543bc6b9-9d60-4ca0-90cf-089df07ef892 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:09.331378 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-543bc6b9-9d60-4ca0-90cf-089df07ef892 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1210 microversion: 2.1 time: 0.100001 Sep 09 13:29:09.331947 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 604/1201] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:09 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:10.186633 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-405207f0-88e2-4ebe-9daa-163f6ddee8ad req-b213749f-2554-4067-b1c8-4928a76e9bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428c6fb7-c138-4140-ab5c-cd7281f4d9d5", "tag": "99690981-b2c4-4955-ad37-4e292e8d8ea0"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:29:10.197524 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-405207f0-88e2-4ebe-9daa-163f6ddee8ad req-b213749f-2554-4067-b1c8-4928a76e9bd8 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:10.197999 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-405207f0-88e2-4ebe-9daa-163f6ddee8ad req-b213749f-2554-4067-b1c8-4928a76e9bd8 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:10.198430 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-405207f0-88e2-4ebe-9daa-163f6ddee8ad req-b213749f-2554-4067-b1c8-4928a76e9bd8 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:10.211715 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-405207f0-88e2-4ebe-9daa-163f6ddee8ad req-b213749f-2554-4067-b1c8-4928a76e9bd8 service nova] Creating event network-changed:99690981-b2c4-4955-ad37-4e292e8d8ea0 for instance 428c6fb7-c138-4140-ab5c-cd7281f4d9d5 on hv-cinder-83124 Sep 09 13:29:10.216880 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-405207f0-88e2-4ebe-9daa-163f6ddee8ad req-b213749f-2554-4067-b1c8-4928a76e9bd8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033977 Sep 09 13:29:10.216880 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 598/1202] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:29:10.356393 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-b8f4ac6c-6bf0-4e81-92ea-fde5a1cfc4b6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:10.357038 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-b8f4ac6c-6bf0-4e81-92ea-fde5a1cfc4b6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:10.363393 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8f4ac6c-6bf0-4e81-92ea-fde5a1cfc4b6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:10.363881 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8f4ac6c-6bf0-4e81-92ea-fde5a1cfc4b6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:10.364390 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8f4ac6c-6bf0-4e81-92ea-fde5a1cfc4b6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:10.365090 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8f4ac6c-6bf0-4e81-92ea-fde5a1cfc4b6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:10.365543 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8f4ac6c-6bf0-4e81-92ea-fde5a1cfc4b6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:10.365967 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-b8f4ac6c-6bf0-4e81-92ea-fde5a1cfc4b6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:10.578701 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-b8f4ac6c-6bf0-4e81-92ea-fde5a1cfc4b6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:10.586883 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-b8f4ac6c-6bf0-4e81-92ea-fde5a1cfc4b6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1265 microversion: 2.1 time: 0.234287 Sep 09 13:29:10.587929 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 605/1203] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:10 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 13:29:11.613062 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5b1bf039-0d4e-40ed-b904-e05459e47521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:11.613790 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5b1bf039-0d4e-40ed-b904-e05459e47521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:11.620646 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b1bf039-0d4e-40ed-b904-e05459e47521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:11.621122 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b1bf039-0d4e-40ed-b904-e05459e47521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:11.621555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b1bf039-0d4e-40ed-b904-e05459e47521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:11.622257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b1bf039-0d4e-40ed-b904-e05459e47521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:11.622704 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b1bf039-0d4e-40ed-b904-e05459e47521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:11.623157 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5b1bf039-0d4e-40ed-b904-e05459e47521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:11.753319 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5b1bf039-0d4e-40ed-b904-e05459e47521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:11.761596 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5b1bf039-0d4e-40ed-b904-e05459e47521 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1265 microversion: 2.1 time: 0.153270 Sep 09 13:29:11.762169 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 599/1204] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:11 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:12.784494 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-490773ac-b507-4e6c-bf30-b0202e27a914 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:12.785105 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-490773ac-b507-4e6c-bf30-b0202e27a914 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:12.792542 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-490773ac-b507-4e6c-bf30-b0202e27a914 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:12.793022 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-490773ac-b507-4e6c-bf30-b0202e27a914 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:12.793457 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-490773ac-b507-4e6c-bf30-b0202e27a914 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:12.794142 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-490773ac-b507-4e6c-bf30-b0202e27a914 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:12.794595 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-490773ac-b507-4e6c-bf30-b0202e27a914 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:12.795015 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-490773ac-b507-4e6c-bf30-b0202e27a914 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:12.926723 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-490773ac-b507-4e6c-bf30-b0202e27a914 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:12.935077 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-490773ac-b507-4e6c-bf30-b0202e27a914 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1265 microversion: 2.1 time: 0.154384 Sep 09 13:29:12.935633 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 606/1205] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:12 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:13.957004 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-892df2ab-219e-4caf-addd-f7557d3e71e1 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:13.957615 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-892df2ab-219e-4caf-addd-f7557d3e71e1 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:13.964902 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-892df2ab-219e-4caf-addd-f7557d3e71e1 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:13.965379 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-892df2ab-219e-4caf-addd-f7557d3e71e1 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:13.965809 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-892df2ab-219e-4caf-addd-f7557d3e71e1 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:13.966491 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-892df2ab-219e-4caf-addd-f7557d3e71e1 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:13.966940 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-892df2ab-219e-4caf-addd-f7557d3e71e1 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:13.967383 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-892df2ab-219e-4caf-addd-f7557d3e71e1 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:14.101319 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-892df2ab-219e-4caf-addd-f7557d3e71e1 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:14.109502 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-892df2ab-219e-4caf-addd-f7557d3e71e1 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1265 microversion: 2.1 time: 0.156372 Sep 09 13:29:14.110069 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 600/1206] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:13 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:15.132024 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-ca1a1020-3e80-4802-9542-fe2c8c3c8164 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:15.132638 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-ca1a1020-3e80-4802-9542-fe2c8c3c8164 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:15.135117 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=2 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:29:15.140762 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1a1020-3e80-4802-9542-fe2c8c3c8164 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:15.141242 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1a1020-3e80-4802-9542-fe2c8c3c8164 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:15.141672 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1a1020-3e80-4802-9542-fe2c8c3c8164 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:15.142364 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1a1020-3e80-4802-9542-fe2c8c3c8164 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:15.142815 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1a1020-3e80-4802-9542-fe2c8c3c8164 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:15.143273 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-ca1a1020-3e80-4802-9542-fe2c8c3c8164 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:15.272019 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-ca1a1020-3e80-4802-9542-fe2c8c3c8164 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:15.280120 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-ca1a1020-3e80-4802-9542-fe2c8c3c8164 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1265 microversion: 2.1 time: 0.151947 Sep 09 13:29:15.280695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 607/1207] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:15 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:16.303233 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-8bc427a7-b885-461a-a326-a27009c943e6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:16.303847 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-8bc427a7-b885-461a-a326-a27009c943e6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:16.306807 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell0:SELECT=4 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:29:16.312210 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bc427a7-b885-461a-a326-a27009c943e6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:16.312688 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bc427a7-b885-461a-a326-a27009c943e6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:16.313117 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bc427a7-b885-461a-a326-a27009c943e6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:16.313799 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bc427a7-b885-461a-a326-a27009c943e6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:16.314247 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bc427a7-b885-461a-a326-a27009c943e6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:16.314665 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-8bc427a7-b885-461a-a326-a27009c943e6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:16.443611 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-8bc427a7-b885-461a-a326-a27009c943e6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:16.451177 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-8bc427a7-b885-461a-a326-a27009c943e6 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1265 microversion: 2.1 time: 0.151827 Sep 09 13:29:16.451763 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 601/1208] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:16 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:17.473118 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e7d3b638-0b02-4147-8944-43946fef315f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:17.473725 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-e7d3b638-0b02-4147-8944-43946fef315f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:17.476015 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell0:SELECT=10 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:29:17.481746 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7d3b638-0b02-4147-8944-43946fef315f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:17.482222 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7d3b638-0b02-4147-8944-43946fef315f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:17.482650 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7d3b638-0b02-4147-8944-43946fef315f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:17.483355 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7d3b638-0b02-4147-8944-43946fef315f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:17.483804 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7d3b638-0b02-4147-8944-43946fef315f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:17.484220 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-e7d3b638-0b02-4147-8944-43946fef315f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:17.617299 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-e7d3b638-0b02-4147-8944-43946fef315f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:17.625716 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e7d3b638-0b02-4147-8944-43946fef315f tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1265 microversion: 2.1 time: 0.156408 Sep 09 13:29:17.626284 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 608/1209] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:17 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:18.649298 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-a7dde351-abbe-493d-8a44-5ddd40eabb14 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:18.650495 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-a7dde351-abbe-493d-8a44-5ddd40eabb14 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:18.656989 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a7dde351-abbe-493d-8a44-5ddd40eabb14 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:18.657476 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a7dde351-abbe-493d-8a44-5ddd40eabb14 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:18.657913 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a7dde351-abbe-493d-8a44-5ddd40eabb14 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:18.658605 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a7dde351-abbe-493d-8a44-5ddd40eabb14 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:18.659079 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a7dde351-abbe-493d-8a44-5ddd40eabb14 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:18.659513 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-a7dde351-abbe-493d-8a44-5ddd40eabb14 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:18.791436 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-a7dde351-abbe-493d-8a44-5ddd40eabb14 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:18.799179 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-a7dde351-abbe-493d-8a44-5ddd40eabb14 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1265 microversion: 2.1 time: 0.153700 Sep 09 13:29:18.799765 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 602/1210] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:18 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:19.821605 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-d25a96d1-c956-444c-bf07-06b4dc607450 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:19.822354 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-d25a96d1-c956-444c-bf07-06b4dc607450 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:19.828876 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d25a96d1-c956-444c-bf07-06b4dc607450 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:19.829368 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d25a96d1-c956-444c-bf07-06b4dc607450 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:19.829804 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d25a96d1-c956-444c-bf07-06b4dc607450 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:19.830525 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d25a96d1-c956-444c-bf07-06b4dc607450 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:19.830983 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d25a96d1-c956-444c-bf07-06b4dc607450 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:19.831437 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-d25a96d1-c956-444c-bf07-06b4dc607450 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:19.969954 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-d25a96d1-c956-444c-bf07-06b4dc607450 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:19.978374 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-d25a96d1-c956-444c-bf07-06b4dc607450 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1265 microversion: 2.1 time: 0.160044 Sep 09 13:29:19.979336 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 609/1211] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:19 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:20.011255 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-ecd71f0c-52a3-4799-943c-f8f0d5ae5f1c req-7d4a5683-4a21-4925-9d71-15ac909fea77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428c6fb7-c138-4140-ab5c-cd7281f4d9d5", "name": "network-vif-plugged", "status": "completed", "tag": "99690981-b2c4-4955-ad37-4e292e8d8ea0"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:29:20.021177 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-ecd71f0c-52a3-4799-943c-f8f0d5ae5f1c req-7d4a5683-4a21-4925-9d71-15ac909fea77 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:20.021835 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-ecd71f0c-52a3-4799-943c-f8f0d5ae5f1c req-7d4a5683-4a21-4925-9d71-15ac909fea77 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:20.022267 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-ecd71f0c-52a3-4799-943c-f8f0d5ae5f1c req-7d4a5683-4a21-4925-9d71-15ac909fea77 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:20.034585 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-ecd71f0c-52a3-4799-943c-f8f0d5ae5f1c req-7d4a5683-4a21-4925-9d71-15ac909fea77 service nova] Creating event network-vif-plugged:99690981-b2c4-4955-ad37-4e292e8d8ea0 for instance 428c6fb7-c138-4140-ab5c-cd7281f4d9d5 on hv-cinder-83124 Sep 09 13:29:20.039676 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-ecd71f0c-52a3-4799-943c-f8f0d5ae5f1c req-7d4a5683-4a21-4925-9d71-15ac909fea77 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032688 Sep 09 13:29:20.041214 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 603/1212] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:29:21.000683 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-a3b80756-667f-4b09-bd66-676ec9f7e14e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:21.001317 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-a3b80756-667f-4b09-bd66-676ec9f7e14e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:21.007744 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3b80756-667f-4b09-bd66-676ec9f7e14e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:21.008221 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3b80756-667f-4b09-bd66-676ec9f7e14e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:21.008917 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3b80756-667f-4b09-bd66-676ec9f7e14e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:21.009974 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3b80756-667f-4b09-bd66-676ec9f7e14e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:21.010423 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3b80756-667f-4b09-bd66-676ec9f7e14e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:21.010844 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-a3b80756-667f-4b09-bd66-676ec9f7e14e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:21.140787 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-a3b80756-667f-4b09-bd66-676ec9f7e14e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:21.148293 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-a3b80756-667f-4b09-bd66-676ec9f7e14e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1265 microversion: 2.1 time: 0.151527 Sep 09 13:29:21.148853 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 610/1213] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:20 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:22.172175 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-12c2eab6-e61c-448c-a58f-1a0d4b9da331 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:22.172878 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-12c2eab6-e61c-448c-a58f-1a0d4b9da331 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:22.179032 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-12c2eab6-e61c-448c-a58f-1a0d4b9da331 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:22.179555 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-12c2eab6-e61c-448c-a58f-1a0d4b9da331 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:22.179993 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-12c2eab6-e61c-448c-a58f-1a0d4b9da331 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:22.180682 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-12c2eab6-e61c-448c-a58f-1a0d4b9da331 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:22.181786 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-12c2eab6-e61c-448c-a58f-1a0d4b9da331 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:22.182232 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-12c2eab6-e61c-448c-a58f-1a0d4b9da331 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:22.316773 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-12c2eab6-e61c-448c-a58f-1a0d4b9da331 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:22.325324 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-12c2eab6-e61c-448c-a58f-1a0d4b9da331 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1451 microversion: 2.1 time: 0.157902 Sep 09 13:29:22.325884 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 604/1214] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:22 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:22.347164 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-c1438036-d203-4f75-9e5b-cee844d32729 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:29:22.347769 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-c1438036-d203-4f75-9e5b-cee844d32729 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:29:22.354573 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1438036-d203-4f75-9e5b-cee844d32729 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:22.355059 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1438036-d203-4f75-9e5b-cee844d32729 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:22.355503 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1438036-d203-4f75-9e5b-cee844d32729 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:22.356191 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1438036-d203-4f75-9e5b-cee844d32729 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:22.356643 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1438036-d203-4f75-9e5b-cee844d32729 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:22.357066 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-c1438036-d203-4f75-9e5b-cee844d32729 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:22.484781 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-c1438036-d203-4f75-9e5b-cee844d32729 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:29:22.493307 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-c1438036-d203-4f75-9e5b-cee844d32729 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1451 microversion: 2.1 time: 0.149900 Sep 09 13:29:22.494519 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 611/1215] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:29:22 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:29:24.294919 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-b7ffc00d-4b1d-40ae-8eaf-522f56b524f5 req-22f3de03-f548-47e7-ab2f-c33d57b48b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428c6fb7-c138-4140-ab5c-cd7281f4d9d5", "tag": "99690981-b2c4-4955-ad37-4e292e8d8ea0"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:29:24.304686 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-b7ffc00d-4b1d-40ae-8eaf-522f56b524f5 req-22f3de03-f548-47e7-ab2f-c33d57b48b9d service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:29:24.305158 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-b7ffc00d-4b1d-40ae-8eaf-522f56b524f5 req-22f3de03-f548-47e7-ab2f-c33d57b48b9d service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:29:24.305582 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-b7ffc00d-4b1d-40ae-8eaf-522f56b524f5 req-22f3de03-f548-47e7-ab2f-c33d57b48b9d service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:29:24.319154 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-b7ffc00d-4b1d-40ae-8eaf-522f56b524f5 req-22f3de03-f548-47e7-ab2f-c33d57b48b9d service nova] Creating event network-changed:99690981-b2c4-4955-ad37-4e292e8d8ea0 for instance 428c6fb7-c138-4140-ab5c-cd7281f4d9d5 on hv-cinder-83124 Sep 09 13:29:24.324264 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-b7ffc00d-4b1d-40ae-8eaf-522f56b524f5 req-22f3de03-f548-47e7-ab2f-c33d57b48b9d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034164 Sep 09 13:29:24.324844 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 605/1216] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:30:57.202037 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:30:57.202904 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG dbcounter [-] [120625] Writing DB stats nova_cell1:SELECT=50 {{(pid=120625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:30:57.203869 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 13:30:57.204015 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Fri Sep 9 13:30:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 (ip 10.222.0.17) !!! Sep 09 13:30:57.205292 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_api:SELECT=26 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:30:57.206029 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG dbcounter [-] [120623] Writing DB stats nova_cell1:SELECT=42 {{(pid=120623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 13:30:57.207330 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 13:30:57.207479 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Fri Sep 9 13:30:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Sep 09 13:30:57.208550 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 13:30:57.208673 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Fri Sep 9 13:30:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.17) !!! Sep 09 13:30:57.210338 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-409b2e83-65a9-4e95-a467-752a30f62758 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:30:57.211697 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-409b2e83-65a9-4e95-a467-752a30f62758 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:30:57.214242 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-0209365d-e2c0-49aa-93cc-b3b4aa50b7cb req-2f56f5f9-e77b-4be9-9fbf-4892c011d23a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428c6fb7-c138-4140-ab5c-cd7281f4d9d5", "tag": "99690981-b2c4-4955-ad37-4e292e8d8ea0"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:30:57.221771 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-409b2e83-65a9-4e95-a467-752a30f62758 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:30:57.221978 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-409b2e83-65a9-4e95-a467-752a30f62758 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:30:57.222311 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-409b2e83-65a9-4e95-a467-752a30f62758 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:30:57.223011 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-409b2e83-65a9-4e95-a467-752a30f62758 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:30:57.223888 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-409b2e83-65a9-4e95-a467-752a30f62758 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:30:57.223888 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-409b2e83-65a9-4e95-a467-752a30f62758 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:30:57.229315 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-0209365d-e2c0-49aa-93cc-b3b4aa50b7cb req-2f56f5f9-e77b-4be9-9fbf-4892c011d23a service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:30:57.230110 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-0209365d-e2c0-49aa-93cc-b3b4aa50b7cb req-2f56f5f9-e77b-4be9-9fbf-4892c011d23a service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:30:57.230766 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-0209365d-e2c0-49aa-93cc-b3b4aa50b7cb req-2f56f5f9-e77b-4be9-9fbf-4892c011d23a service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:30:57.242422 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-0209365d-e2c0-49aa-93cc-b3b4aa50b7cb req-2f56f5f9-e77b-4be9-9fbf-4892c011d23a service nova] Creating event network-changed:99690981-b2c4-4955-ad37-4e292e8d8ea0 for instance 428c6fb7-c138-4140-ab5c-cd7281f4d9d5 on hv-cinder-83124 Sep 09 13:30:57.247854 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-0209365d-e2c0-49aa-93cc-b3b4aa50b7cb req-2f56f5f9-e77b-4be9-9fbf-4892c011d23a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044735 Sep 09 13:30:57.248456 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 606/1217] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:30:57.255200 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-409b2e83-65a9-4e95-a467-752a30f62758 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:30:57.344718 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-409b2e83-65a9-4e95-a467-752a30f62758 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "DELETE /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 204 len: 0 microversion: 2.1 time: 0.144090 Sep 09 13:30:57.346110 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 612/1218] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:30:57 2022] DELETE /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:30:57.356487 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-5de4c0d2-3923-4c19-9071-0d265df4801e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:30:57.357490 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-5de4c0d2-3923-4c19-9071-0d265df4801e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:30:57.366284 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5de4c0d2-3923-4c19-9071-0d265df4801e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:30:57.366779 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5de4c0d2-3923-4c19-9071-0d265df4801e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:30:57.367245 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5de4c0d2-3923-4c19-9071-0d265df4801e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:30:57.367946 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5de4c0d2-3923-4c19-9071-0d265df4801e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:30:57.368395 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5de4c0d2-3923-4c19-9071-0d265df4801e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:30:57.368817 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-5de4c0d2-3923-4c19-9071-0d265df4801e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:30:57.553776 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-5de4c0d2-3923-4c19-9071-0d265df4801e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:30:57.562499 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-5de4c0d2-3923-4c19-9071-0d265df4801e tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1576 microversion: 2.1 time: 0.211813 Sep 09 13:30:57.563100 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 607/1219] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:30:57 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:30:58.585351 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-bddd23b4-e20b-4f0f-a823-deff9b8c5894 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:30:58.586041 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-bddd23b4-e20b-4f0f-a823-deff9b8c5894 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:30:58.592210 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bddd23b4-e20b-4f0f-a823-deff9b8c5894 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:30:58.592692 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bddd23b4-e20b-4f0f-a823-deff9b8c5894 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:30:58.593158 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bddd23b4-e20b-4f0f-a823-deff9b8c5894 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:30:58.593855 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bddd23b4-e20b-4f0f-a823-deff9b8c5894 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:30:58.594302 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bddd23b4-e20b-4f0f-a823-deff9b8c5894 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:30:58.594717 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-bddd23b4-e20b-4f0f-a823-deff9b8c5894 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:30:58.782550 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-bddd23b4-e20b-4f0f-a823-deff9b8c5894 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:30:58.790154 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-bddd23b4-e20b-4f0f-a823-deff9b8c5894 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1576 microversion: 2.1 time: 0.209131 Sep 09 13:30:58.790709 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 613/1220] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:30:58 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1576 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:30:59.432441 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-cd72c61f-a6c2-42bf-8c5c-b40aab3259f5 req-6d263a3d-3d34-43c5-bfe6-592e5f961a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428c6fb7-c138-4140-ab5c-cd7281f4d9d5", "name": "network-vif-deleted", "tag": "99690981-b2c4-4955-ad37-4e292e8d8ea0"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:30:59.446191 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-cd72c61f-a6c2-42bf-8c5c-b40aab3259f5 req-6d263a3d-3d34-43c5-bfe6-592e5f961a49 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:30:59.446678 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-cd72c61f-a6c2-42bf-8c5c-b40aab3259f5 req-6d263a3d-3d34-43c5-bfe6-592e5f961a49 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:30:59.447130 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-cd72c61f-a6c2-42bf-8c5c-b40aab3259f5 req-6d263a3d-3d34-43c5-bfe6-592e5f961a49 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:30:59.459438 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-cd72c61f-a6c2-42bf-8c5c-b40aab3259f5 req-6d263a3d-3d34-43c5-bfe6-592e5f961a49 service nova] Creating event network-vif-deleted:99690981-b2c4-4955-ad37-4e292e8d8ea0 for instance 428c6fb7-c138-4140-ab5c-cd7281f4d9d5 on hv-cinder-83124 Sep 09 13:30:59.464304 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-cd72c61f-a6c2-42bf-8c5c-b40aab3259f5 req-6d263a3d-3d34-43c5-bfe6-592e5f961a49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035589 Sep 09 13:30:59.465422 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 608/1221] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:30:59.814376 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-3623d69a-8b45-43ff-856e-6df99c18e82d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:30:59.814968 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-3623d69a-8b45-43ff-856e-6df99c18e82d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:30:59.822774 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3623d69a-8b45-43ff-856e-6df99c18e82d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:30:59.823375 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3623d69a-8b45-43ff-856e-6df99c18e82d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:30:59.823876 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3623d69a-8b45-43ff-856e-6df99c18e82d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:30:59.824641 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3623d69a-8b45-43ff-856e-6df99c18e82d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:30:59.825506 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3623d69a-8b45-43ff-856e-6df99c18e82d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:30:59.826641 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3623d69a-8b45-43ff-856e-6df99c18e82d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:30:59.863779 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3623d69a-8b45-43ff-856e-6df99c18e82d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:30:59.864199 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3623d69a-8b45-43ff-856e-6df99c18e82d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:30:59.864661 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-3623d69a-8b45-43ff-856e-6df99c18e82d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:30:59.865105 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-3623d69a-8b45-43ff-856e-6df99c18e82d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lazy-loading 'fault' on Instance uuid 428c6fb7-c138-4140-ab5c-cd7281f4d9d5 {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:30:59.908654 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-3623d69a-8b45-43ff-856e-6df99c18e82d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:30:59.916321 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-3623d69a-8b45-43ff-856e-6df99c18e82d tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 200 len: 1230 microversion: 2.1 time: 0.106601 Sep 09 13:30:59.916871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 614/1222] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:30:59 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:31:00.941391 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-862f7e37-a581-47b1-9528-a5b2651392ea tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:31:00.942117 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-862f7e37-a581-47b1-9528-a5b2651392ea tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 428c6fb7-c138-4140-ab5c-cd7281f4d9d5] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:31:00.948333 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-862f7e37-a581-47b1-9528-a5b2651392ea tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:00.948910 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-862f7e37-a581-47b1-9528-a5b2651392ea tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:00.949293 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-862f7e37-a581-47b1-9528-a5b2651392ea tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:00.950069 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-862f7e37-a581-47b1-9528-a5b2651392ea tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:00.950521 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-862f7e37-a581-47b1-9528-a5b2651392ea tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:00.951886 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-862f7e37-a581-47b1-9528-a5b2651392ea tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:00.965621 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-862f7e37-a581-47b1-9528-a5b2651392ea tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] HTTP exception thrown: Instance 428c6fb7-c138-4140-ab5c-cd7281f4d9d5 could not be found. Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-862f7e37-a581-47b1-9528-a5b2651392ea tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Request method failure captured: Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 HTTP/1.1 Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGz6GzI1Uyle-Gz1YxLC3KiPbSFzGZT8Pt_cIenmZMxXss7FIYyZSjlzf-_-TZq9MXG9BXzKs_KrNi1gPlRyhFxgiYQYboRwAE8YxPv2weht3x7Fpin-PDE3kFrsquP-RJdHRrkIUxALFzBplnX5YJrY0Tt3Lynz8lkMHAR-3VcrGZKE Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: b7dd3b78c2a74ac4baa2f0bb21482ed9 Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-TestVolumeBootPattern-782269405 Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:31:00.968209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:31:00.970085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b7dd3b78c2a74ac4baa2f0bb21482ed9", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:31:00.970085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-TestVolumeBootPattern-782269405 Sep 09 13:31:00.970085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: b7dd3b78c2a74ac4baa2f0bb21482ed9 Sep 09 13:31:00.970085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-TestVolumeBootPattern-782269405 Sep 09 13:31:00.970085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-TestVolumeBootPattern-782269405-project Sep 09 13:31:00.970085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:31:00.970085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:31:00.970085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: 5ab98652cbab470b8a385fe6381dd80b Sep 09 13:31:00.970085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-TestVolumeBootPattern-782269405-project Sep 09 13:31:00.970085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:31:00.970085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance 428c6fb7-c138-4140-ab5c-cd7281f4d9d5 could not be found. Sep 09 13:31:00.970085 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '428c6fb7-c138-4140-ab5c-cd7281f4d9d5'} Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 428c6fb7-c138-4140-ab5c-cd7281f4d9d5 could not be found. Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:31:00.971368 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 428c6fb7-c138-4140-ab5c-cd7281f4d9d5 could not be found. Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 428c6fb7-c138-4140-ab5c-cd7281f4d9d5 could not be found. Sep 09 13:31:00.973927 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:00.975562 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-862f7e37-a581-47b1-9528-a5b2651392ea tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Returning 404 to user: Instance 428c6fb7-c138-4140-ab5c-cd7281f4d9d5 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:31:00.975562 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-862f7e37-a581-47b1-9528-a5b2651392ea tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5" status: 404 len: 111 microversion: 2.1 time: 0.033041 Sep 09 13:31:00.975562 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 609/1223] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:31:00 2022] GET /compute/v2.1/servers/428c6fb7-c138-4140-ab5c-cd7281f4d9d5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:31:04.036250 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-9f598621-6ee9-4b77-b98b-886c76ffefdc tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:31:04.036772 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9f598621-6ee9-4b77-b98b-886c76ffefdc tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:31:04.045695 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f598621-6ee9-4b77-b98b-886c76ffefdc tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:04.046560 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f598621-6ee9-4b77-b98b-886c76ffefdc tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:04.047264 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f598621-6ee9-4b77-b98b-886c76ffefdc tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:04.048160 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f598621-6ee9-4b77-b98b-886c76ffefdc tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:04.048780 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f598621-6ee9-4b77-b98b-886c76ffefdc tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:04.049404 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-9f598621-6ee9-4b77-b98b-886c76ffefdc tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:04.077235 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-9f598621-6ee9-4b77-b98b-886c76ffefdc tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Going to try to terminate instance {{(pid=120625) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 13:31:04.100286 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-920cf028-cc28-4371-9862-af36724b8be8 req-d7e04a96-615a-408c-a2e6-c16dfe7fa1bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81fd4b5-5e20-4394-989e-72ae8e685dec", "tag": "1cde3fbe-c7f7-485a-ae94-ea8608a52b62"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:31:04.112717 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-920cf028-cc28-4371-9862-af36724b8be8 req-d7e04a96-615a-408c-a2e6-c16dfe7fa1bf service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:04.115417 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-920cf028-cc28-4371-9862-af36724b8be8 req-d7e04a96-615a-408c-a2e6-c16dfe7fa1bf service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:04.116336 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-920cf028-cc28-4371-9862-af36724b8be8 req-d7e04a96-615a-408c-a2e6-c16dfe7fa1bf service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:04.128720 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-920cf028-cc28-4371-9862-af36724b8be8 req-d7e04a96-615a-408c-a2e6-c16dfe7fa1bf service nova] Creating event network-changed:1cde3fbe-c7f7-485a-ae94-ea8608a52b62 for instance a81fd4b5-5e20-4394-989e-72ae8e685dec on hv-cinder-83124 Sep 09 13:31:04.134655 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-920cf028-cc28-4371-9862-af36724b8be8 req-d7e04a96-615a-408c-a2e6-c16dfe7fa1bf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098417 Sep 09 13:31:04.135759 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 610/1224] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:31:04.177602 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-9f598621-6ee9-4b77-b98b-886c76ffefdc tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 204 len: 0 microversion: 2.1 time: 0.145327 Sep 09 13:31:04.178197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 615/1225] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:31:04 2022] DELETE /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 13:31:04.187206 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-9363a0a1-1471-467a-bb45-2381099542f4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:31:04.188072 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-9363a0a1-1471-467a-bb45-2381099542f4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:31:04.194521 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9363a0a1-1471-467a-bb45-2381099542f4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:04.195347 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9363a0a1-1471-467a-bb45-2381099542f4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:04.196168 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9363a0a1-1471-467a-bb45-2381099542f4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:04.196988 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9363a0a1-1471-467a-bb45-2381099542f4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:04.197697 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9363a0a1-1471-467a-bb45-2381099542f4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:04.198355 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-9363a0a1-1471-467a-bb45-2381099542f4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:04.334392 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.policy [None req-9363a0a1-1471-467a-bb45-2381099542f4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120623) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:31:04.342228 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-9363a0a1-1471-467a-bb45-2381099542f4 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1575 microversion: 2.1 time: 0.159569 Sep 09 13:31:04.342798 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 611/1226] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:31:04 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:31:05.367005 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-dca4f4a8-233a-4561-a321-e0cde65c0a58 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:31:05.368382 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-dca4f4a8-233a-4561-a321-e0cde65c0a58 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:31:05.375402 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca4f4a8-233a-4561-a321-e0cde65c0a58 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:05.375894 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca4f4a8-233a-4561-a321-e0cde65c0a58 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:05.376329 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca4f4a8-233a-4561-a321-e0cde65c0a58 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:05.377034 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca4f4a8-233a-4561-a321-e0cde65c0a58 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:05.377682 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca4f4a8-233a-4561-a321-e0cde65c0a58 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:05.378107 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-dca4f4a8-233a-4561-a321-e0cde65c0a58 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:05.697002 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-dca4f4a8-233a-4561-a321-e0cde65c0a58 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:31:05.705511 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-dca4f4a8-233a-4561-a321-e0cde65c0a58 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1575 microversion: 2.1 time: 0.342942 Sep 09 13:31:05.706072 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 616/1227] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:31:05 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1575 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:31:06.347757 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [req-6fdd8dfa-990b-41ff-98c5-6d46b7816be1 req-e6a46c74-e6c8-4286-ae8f-89a55f407a94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81fd4b5-5e20-4394-989e-72ae8e685dec", "name": "network-vif-deleted", "tag": "1cde3fbe-c7f7-485a-ae94-ea8608a52b62"}]} {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 13:31:06.359103 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6fdd8dfa-990b-41ff-98c5-6d46b7816be1 req-e6a46c74-e6c8-4286-ae8f-89a55f407a94 service nova] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:06.359589 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6fdd8dfa-990b-41ff-98c5-6d46b7816be1 req-e6a46c74-e6c8-4286-ae8f-89a55f407a94 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:06.360021 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [req-6fdd8dfa-990b-41ff-98c5-6d46b7816be1 req-e6a46c74-e6c8-4286-ae8f-89a55f407a94 service nova] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:06.372265 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.compute.server_external_events [req-6fdd8dfa-990b-41ff-98c5-6d46b7816be1 req-e6a46c74-e6c8-4286-ae8f-89a55f407a94 service nova] Creating event network-vif-deleted:1cde3fbe-c7f7-485a-ae94-ea8608a52b62 for instance a81fd4b5-5e20-4394-989e-72ae8e685dec on hv-cinder-83124 Sep 09 13:31:06.377056 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [req-6fdd8dfa-990b-41ff-98c5-6d46b7816be1 req-e6a46c74-e6c8-4286-ae8f-89a55f407a94 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033107 Sep 09 13:31:06.377649 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 612/1228] 10.222.0.17 () {64 vars in 1317 bytes} [Fri Sep 9 13:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 13:31:06.730009 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-8b7f76f9-6b32-4d77-8f4d-1548f7b9ae2a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:31:06.730610 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-8b7f76f9-6b32-4d77-8f4d-1548f7b9ae2a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:31:06.737716 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b7f76f9-6b32-4d77-8f4d-1548f7b9ae2a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:06.738197 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b7f76f9-6b32-4d77-8f4d-1548f7b9ae2a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:06.738640 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b7f76f9-6b32-4d77-8f4d-1548f7b9ae2a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:06.739358 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b7f76f9-6b32-4d77-8f4d-1548f7b9ae2a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:06.739805 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b7f76f9-6b32-4d77-8f4d-1548f7b9ae2a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:06.740226 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b7f76f9-6b32-4d77-8f4d-1548f7b9ae2a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:06.774054 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b7f76f9-6b32-4d77-8f4d-1548f7b9ae2a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:06.774530 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b7f76f9-6b32-4d77-8f4d-1548f7b9ae2a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:06.774958 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-8b7f76f9-6b32-4d77-8f4d-1548f7b9ae2a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:06.775416 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.objects.instance [None req-8b7f76f9-6b32-4d77-8f4d-1548f7b9ae2a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lazy-loading 'fault' on Instance uuid a81fd4b5-5e20-4394-989e-72ae8e685dec {{(pid=120625) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 13:31:06.816886 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.policy [None req-8b7f76f9-6b32-4d77-8f4d-1548f7b9ae2a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab98652cbab470b8a385fe6381dd80b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7dd3b78c2a74ac4baa2f0bb21482ed9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120625) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 13:31:06.825027 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-8b7f76f9-6b32-4d77-8f4d-1548f7b9ae2a tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 200 len: 1230 microversion: 2.1 time: 0.098868 Sep 09 13:31:06.825593 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 617/1229] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:31:06 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 13:31:07.849500 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-84a3d5c8-245a-42d2-8365-995ea9906499 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:31:07.850209 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-84a3d5c8-245a-42d2-8365-995ea9906499 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: a81fd4b5-5e20-4394-989e-72ae8e685dec] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:31:07.856713 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a3d5c8-245a-42d2-8365-995ea9906499 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:07.857201 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a3d5c8-245a-42d2-8365-995ea9906499 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:07.857667 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a3d5c8-245a-42d2-8365-995ea9906499 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:07.858355 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a3d5c8-245a-42d2-8365-995ea9906499 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:07.858807 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a3d5c8-245a-42d2-8365-995ea9906499 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:07.859257 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-84a3d5c8-245a-42d2-8365-995ea9906499 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:07.872370 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-84a3d5c8-245a-42d2-8365-995ea9906499 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] HTTP exception thrown: Instance a81fd4b5-5e20-4394-989e-72ae8e685dec could not be found. Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-84a3d5c8-245a-42d2-8365-995ea9906499 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Request method failure captured: Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec HTTP/1.1 Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGz6GzI1Uyle-Gz1YxLC3KiPbSFzGZT8Pt_cIenmZMxXss7FIYyZSjlzf-_-TZq9MXG9BXzKs_KrNi1gPlRyhFxgiYQYboRwAE8YxPv2weht3x7Fpin-PDE3kFrsquP-RJdHRrkIUxALFzBplnX5YJrY0Tt3Lynz8lkMHAR-3VcrGZKE Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: b7dd3b78c2a74ac4baa2f0bb21482ed9 Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-TestVolumeBootPattern-782269405 Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:31:07.874552 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:31:07.876306 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b7dd3b78c2a74ac4baa2f0bb21482ed9", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:31:07.876306 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-TestVolumeBootPattern-782269405 Sep 09 13:31:07.876306 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: b7dd3b78c2a74ac4baa2f0bb21482ed9 Sep 09 13:31:07.876306 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-TestVolumeBootPattern-782269405 Sep 09 13:31:07.876306 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-TestVolumeBootPattern-782269405-project Sep 09 13:31:07.876306 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:31:07.876306 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:31:07.876306 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: 5ab98652cbab470b8a385fe6381dd80b Sep 09 13:31:07.876306 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-TestVolumeBootPattern-782269405-project Sep 09 13:31:07.876306 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:31:07.876306 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance a81fd4b5-5e20-4394-989e-72ae8e685dec could not be found. Sep 09 13:31:07.876306 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': 'a81fd4b5-5e20-4394-989e-72ae8e685dec'} Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81fd4b5-5e20-4394-989e-72ae8e685dec could not be found. Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:31:07.877150 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81fd4b5-5e20-4394-989e-72ae8e685dec could not be found. Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81fd4b5-5e20-4394-989e-72ae8e685dec could not be found. Sep 09 13:31:07.878483 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:07.879842 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-84a3d5c8-245a-42d2-8365-995ea9906499 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Returning 404 to user: Instance a81fd4b5-5e20-4394-989e-72ae8e685dec could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:31:07.879842 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-84a3d5c8-245a-42d2-8365-995ea9906499 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec" status: 404 len: 111 microversion: 2.1 time: 0.031280 Sep 09 13:31:07.879842 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 613/1230] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:31:07 2022] GET /compute/v2.1/servers/a81fd4b5-5e20-4394-989e-72ae8e685dec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:31:08.310061 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-747c625f-4000-45a4-a4c0-8c4231025518 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:31:08.311569 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.compute.api [None req-747c625f-4000-45a4-a4c0-8c4231025518 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120625) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:31:08.318018 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747c625f-4000-45a4-a4c0-8c4231025518 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:08.318497 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747c625f-4000-45a4-a4c0-8c4231025518 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:08.318925 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747c625f-4000-45a4-a4c0-8c4231025518 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:08.319633 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747c625f-4000-45a4-a4c0-8c4231025518 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:08.320088 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747c625f-4000-45a4-a4c0-8c4231025518 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:08.320504 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG oslo_concurrency.lockutils [None req-747c625f-4000-45a4-a4c0-8c4231025518 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:08.336564 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.wsgi [None req-747c625f-4000-45a4-a4c0-8c4231025518 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] HTTP exception thrown: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-747c625f-4000-45a4-a4c0-8c4231025518 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Request method failure captured: Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: request: DELETE /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 HTTP/1.1 Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept: application/json Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Accept-Encoding: identity Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Connection: close Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Length: 0 Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Content-Type: application/json Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Host: 10.222.0.17 Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: Openstack-System-Scope: None Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: User-Agent: python-urllib3/1.26.12 Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Auth-Token: gAAAAABjGz6GzI1Uyle-Gz1YxLC3KiPbSFzGZT8Pt_cIenmZMxXss7FIYyZSjlzf-_-TZq9MXG9BXzKs_KrNi1gPlRyhFxgiYQYboRwAE8YxPv2weht3x7Fpin-PDE3kFrsquP-RJdHRrkIUxALFzBplnX5YJrY0Tt3Lynz8lkMHAR-3VcrGZKE Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Id: None Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Domain-Name: None Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Identity-Status: Confirmed Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Is-Admin-Project: True Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Id: default Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Domain-Name: Default Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Id: b7dd3b78c2a74ac4baa2f0bb21482ed9 Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Project-Name: tempest-TestVolumeBootPattern-782269405 Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Role: reader,member Sep 09 13:31:08.338195 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Roles: reader,member Sep 09 13:31:08.339949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b7dd3b78c2a74ac4baa2f0bb21482ed9", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:31:08.339949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant: tempest-TestVolumeBootPattern-782269405 Sep 09 13:31:08.339949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Id: b7dd3b78c2a74ac4baa2f0bb21482ed9 Sep 09 13:31:08.339949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-Tenant-Name: tempest-TestVolumeBootPattern-782269405 Sep 09 13:31:08.339949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User: tempest-TestVolumeBootPattern-782269405-project Sep 09 13:31:08.339949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Id: default Sep 09 13:31:08.339949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Domain-Name: Default Sep 09 13:31:08.339949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Id: 5ab98652cbab470b8a385fe6381dd80b Sep 09 13:31:08.339949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: X-User-Name: tempest-TestVolumeBootPattern-782269405-project Sep 09 13:31:08.339949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: method: > Sep 09 13:31:08.339949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: exception: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:31:08.339949 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: action_args: {'id': '982c0e01-d662-4756-b9c4-4f660054ed71'} Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:31:08.340871 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:31:08.342829 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: ERROR nova.api.openstack.wsgi Sep 09 13:31:08.344361 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-747c625f-4000-45a4-a4c0-8c4231025518 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Returning 404 to user: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. {{(pid=120625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:31:08.344361 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-747c625f-4000-45a4-a4c0-8c4231025518 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "DELETE /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 404 len: 111 microversion: 2.1 time: 0.033411 Sep 09 13:31:08.344361 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 618/1231] 10.222.0.17 () {58 vars in 1239 bytes} [Fri Sep 9 13:31:08 2022] DELETE /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:31:08.348916 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-27940ddb-55b4-45f0-97f2-ed193c2fa56b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '>' {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:31:08.349533 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.compute.api [None req-27940ddb-55b4-45f0-97f2-ed193c2fa56b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] [instance: 982c0e01-d662-4756-b9c4-4f660054ed71] Fetching instance by UUID {{(pid=120623) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 13:31:08.355527 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-27940ddb-55b4-45f0-97f2-ed193c2fa56b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:08.356012 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-27940ddb-55b4-45f0-97f2-ed193c2fa56b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:08.356452 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-27940ddb-55b4-45f0-97f2-ed193c2fa56b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:08.357922 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-27940ddb-55b4-45f0-97f2-ed193c2fa56b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Acquiring lock "097b70e7-360a-44be-bba2-9f31f45eed49" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 13:31:08.358386 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-27940ddb-55b4-45f0-97f2-ed193c2fa56b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 13:31:08.358817 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG oslo_concurrency.lockutils [None req-27940ddb-55b4-45f0-97f2-ed193c2fa56b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Lock "097b70e7-360a-44be-bba2-9f31f45eed49" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 13:31:08.371948 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.wsgi [None req-27940ddb-55b4-45f0-97f2-ed193c2fa56b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] HTTP exception thrown: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-27940ddb-55b4-45f0-97f2-ed193c2fa56b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Request method failure captured: Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: request: GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 HTTP/1.1 Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept: application/json Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Accept-Encoding: identity Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Connection: close Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Length: 0 Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Content-Type: application/json Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Host: 10.222.0.17 Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: Openstack-System-Scope: None Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: User-Agent: python-urllib3/1.26.12 Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Auth-Token: gAAAAABjGz6GzI1Uyle-Gz1YxLC3KiPbSFzGZT8Pt_cIenmZMxXss7FIYyZSjlzf-_-TZq9MXG9BXzKs_KrNi1gPlRyhFxgiYQYboRwAE8YxPv2weht3x7Fpin-PDE3kFrsquP-RJdHRrkIUxALFzBplnX5YJrY0Tt3Lynz8lkMHAR-3VcrGZKE Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Id: None Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Domain-Name: None Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Identity-Status: Confirmed Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Is-Admin-Project: True Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Id: default Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Domain-Name: Default Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Id: b7dd3b78c2a74ac4baa2f0bb21482ed9 Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Project-Name: tempest-TestVolumeBootPattern-782269405 Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Role: reader,member Sep 09 13:31:08.373590 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Roles: reader,member Sep 09 13:31:08.375397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b7dd3b78c2a74ac4baa2f0bb21482ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b7dd3b78c2a74ac4baa2f0bb21482ed9", "adminURL": "http://10.222.0.17:8080"}]}] Sep 09 13:31:08.375397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant: tempest-TestVolumeBootPattern-782269405 Sep 09 13:31:08.375397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Id: b7dd3b78c2a74ac4baa2f0bb21482ed9 Sep 09 13:31:08.375397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-Tenant-Name: tempest-TestVolumeBootPattern-782269405 Sep 09 13:31:08.375397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User: tempest-TestVolumeBootPattern-782269405-project Sep 09 13:31:08.375397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Id: default Sep 09 13:31:08.375397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Domain-Name: Default Sep 09 13:31:08.375397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Id: 5ab98652cbab470b8a385fe6381dd80b Sep 09 13:31:08.375397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: X-User-Name: tempest-TestVolumeBootPattern-782269405-project Sep 09 13:31:08.375397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: method: > Sep 09 13:31:08.375397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: exception: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:31:08.375397 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: action_args: {'id': '982c0e01-d662-4756-b9c4-4f660054ed71'} Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: {{(pid=120623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 13:31:08.376578 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. Sep 09 13:31:08.378183 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: ERROR nova.api.openstack.wsgi Sep 09 13:31:08.379825 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: DEBUG nova.api.openstack.wsgi [None req-27940ddb-55b4-45f0-97f2-ed193c2fa56b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Returning 404 to user: Instance 982c0e01-d662-4756-b9c4-4f660054ed71 could not be found. {{(pid=120623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 13:31:08.379825 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: INFO nova.api.openstack.requestlog [None req-27940ddb-55b4-45f0-97f2-ed193c2fa56b tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71" status: 404 len: 111 microversion: 2.1 time: 0.029895 Sep 09 13:31:08.379825 dv-cinder-831247-26-iscsi devstack@n-api.service[120623]: [pid: 120623|app: 0|req: 614/1232] 10.222.0.17 () {58 vars in 1236 bytes} [Fri Sep 9 13:31:08 2022] GET /compute/v2.1/servers/982c0e01-d662-4756-b9c4-4f660054ed71 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 13:31:09.672916 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: DEBUG nova.api.openstack.wsgi [None req-e3ccd261-742d-43b8-9ab5-a24f050ae087 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] Calling method '.version_select at 0x7fd4a1c14550>' {{(pid=120625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 13:31:09.696795 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: INFO nova.api.openstack.requestlog [None req-e3ccd261-742d-43b8-9ab5-a24f050ae087 tempest-TestVolumeBootPattern-782269405 tempest-TestVolumeBootPattern-782269405-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-826659176" status: 202 len: 0 microversion: 2.1 time: 0.027831 Sep 09 13:31:09.697376 dv-cinder-831247-26-iscsi devstack@n-api.service[120625]: [pid: 120625|app: 0|req: 619/1233] 10.222.0.17 () {58 vars in 1260 bytes} [Fri Sep 9 13:31:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-826659176 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)